-- Logs begin at Tue 2022-08-09 18:14:20 UTC, end at Tue 2022-08-09 19:31:28 UTC. -- Aug 09 19:05:10.125438 dv-cinder-852654-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 19:05:10.136852 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 19:05:10 2022] *** Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: nodename: dv-cinder-852654-1-iscsi Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: machine: x86_64 Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: clock source: unix Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: pcre jit disabled Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: detected number of CPU cores: 4 Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: current working directory: / Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: detected binary path: /usr/bin/uwsgi-core Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: your processes number limit is 47680 Aug 09 19:05:10.139506 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: your memory page size is 4096 bytes Aug 09 19:05:10.140692 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: detected max file descriptor number: 2048 Aug 09 19:05:10.140692 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: lock engine: pthread robust mutexes Aug 09 19:05:10.140692 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: thunder lock: enabled Aug 09 19:05:10.140692 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 19:05:10.140692 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 19:05:10.180347 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: Python main interpreter initialized at 0x55d99a7cb9c0 Aug 09 19:05:10.180347 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: python threads support enabled Aug 09 19:05:10.180347 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: your server socket listen backlog is limited to 100 connections Aug 09 19:05:10.180347 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: your mercy for graceful operations on workers is 90 seconds Aug 09 19:05:10.180821 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 19:05:10.180821 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: *** Operational MODE: preforking *** Aug 09 19:05:10.181074 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: *** uWSGI is running in multiple interpreter mode *** Aug 09 19:05:10.181074 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: spawned uWSGI master process (pid: 103310) Aug 09 19:05:10.181293 dv-cinder-852654-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 19:05:10.182135 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: spawned uWSGI worker 1 (pid: 103311, cores: 1) Aug 09 19:05:10.182498 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: spawned uWSGI worker 2 (pid: 103312, cores: 1) Aug 09 19:05:10.182644 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 19:05:10.858600 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 19:05:10.872947 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 19:05:11.952994 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 19:05:11.952994 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: from cryptography.utils import int_from_bytes Aug 09 19:05:11.953703 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 19:05:11.953703 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: from cryptography.utils import int_from_bytes Aug 09 19:05:11.962652 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 19:05:11.962652 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: from cryptography.utils import int_from_bytes Aug 09 19:05:11.963126 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 19:05:11.963126 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: from cryptography.utils import int_from_bytes Aug 09 19:05:14.527617 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 19:05:14.528167 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 19:05:14.528383 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 19:05:14.528771 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 19:05:14.529026 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 19:05:14.529412 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.529738 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.530057 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.530373 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.530699 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.531008 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.531323 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.531641 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.531963 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.532221 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.532568 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.532889 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852654-1-iscsi {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.533207 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.533440 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 19:05:14.533797 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.533878 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 19:05:14.533954 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.534115 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.534265 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 19:05:14.534414 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.534565 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 19:05:14.534730 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.534820 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 19:05:14.535031 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.535197 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.535519 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.535639 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.535844 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.535940 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.536475 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.536644 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.536739 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.536970 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.537065 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.537362 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.537465 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.537671 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.537766 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.537989 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.538209 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.538403 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.538597 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.538796 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.538947 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.538947 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.539300 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.539300 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852654-1-iscsi {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.539652 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852654-1-iscsi {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.539829 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.540042 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.540237 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.540463 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.540620 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.540837 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.540995 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.541172 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.541351 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.541545 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.541737 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.541870 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.542025 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.542160 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.542160 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.542435 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.542574 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.542707 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.542837 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.542958 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.543118 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.543251 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.543373 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.543494 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.543622 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.543752 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.543894 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.544018 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.544139 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.544291 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.544460 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.544587 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.544710 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.544830 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.544951 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.545086 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.545210 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.545424 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.545557 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852654-1-iscsi {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.545691 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.545821 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.545944 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.546073 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.546196 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.546318 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.546482 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.546615 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.546747 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.546932 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.547102 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.547268 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.547393 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.547552 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.547679 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.547856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.547979 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.548162 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.548297 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.548493 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.548636 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.548803 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.548939 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.549108 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.549246 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.549413 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.549541 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.549716 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.549851 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.550019 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.550146 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.550326 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.550451 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.550636 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.550779 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.550941 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.551077 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.551244 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.551369 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.551496 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.552232 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.552475 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.552609 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.552801 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.553034 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.553175 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.553372 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.553498 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.553705 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.553843 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.553979 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.554113 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.554237 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.554366 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.554516 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.554651 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.554842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.554971 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.555156 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.555282 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.555468 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.555595 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.555783 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.555911 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.556095 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.556221 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.556394 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.556535 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.556675 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.556800 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.557263 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.557381 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.557515 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.557637 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.557832 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.557976 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.558137 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.558264 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.558442 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.558581 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.558746 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.558874 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.559043 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.559168 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.559347 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.559486 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.559652 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.559779 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.559956 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.560084 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.560259 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.560397 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.560571 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.560704 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.560874 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.561000 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.561179 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.561315 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.561482 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.561609 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.561784 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.561910 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.562098 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.562235 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.562413 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.562539 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.562717 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.562843 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.563021 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.563157 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.563327 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.563463 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.563610 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.563736 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.563915 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.564043 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.564217 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.564334 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.564541 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.564669 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.564857 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.564984 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.565156 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.565281 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.565457 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.565577 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.565758 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.565891 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.566057 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.566182 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.566360 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.566493 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.566665 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.566798 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.566959 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.567084 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.567287 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.568027 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.568206 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.568335 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.568535 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.568843 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.568967 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.569146 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.569275 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.569449 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.569576 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.569753 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.569880 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.570055 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.570193 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.570355 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.570483 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.570657 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.570784 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.570954 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.571088 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.571260 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.571403 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.571576 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.571701 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.571882 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.572010 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.572187 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.572312 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.572509 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.572640 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.572826 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.572963 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.573137 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.573270 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.573459 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.573585 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.573770 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.573898 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.574079 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.574206 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.574401 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.574537 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.574705 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.574832 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.575015 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.575141 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.575330 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.575468 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.575636 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.575766 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.575944 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.576070 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.576251 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.576384 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.576587 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.576715 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.576893 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.577019 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.577202 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.577331 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.577508 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.577644 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.577815 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.577949 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.578118 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.578246 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.578432 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.578557 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.578750 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.578878 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.579056 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.579183 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.579363 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.579488 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.579672 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.579806 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.580008 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.580132 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:05:14.580278 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.580405 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.580639 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.580777 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.580979 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.581108 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.581291 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.581429 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.581612 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.581738 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.581930 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.582058 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.582240 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.582368 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.582549 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.582688 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.582856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.582983 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.583438 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.583577 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.583875 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.584010 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.584191 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.584316 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.584533 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.584680 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.584848 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.584985 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.585161 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.585289 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.585472 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.585606 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.585783 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.585919 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.586092 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.586221 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.586413 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.586540 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.586728 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.586853 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.587042 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.587169 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.587354 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.587482 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.587669 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.587797 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.587980 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.588113 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.588287 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.588413 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.588631 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.588765 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.588900 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.589024 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.589200 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.589328 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.589503 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.589638 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.589811 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.589937 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.590112 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.590238 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.590428 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.590556 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.590751 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.590877 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.591056 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.591191 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.591386 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.591521 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.591689 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.591816 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.591999 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.592143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.592308 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.592456 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.592643 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.592771 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.592951 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.593091 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.593269 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.593395 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.593580 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.593706 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.593884 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.594020 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.594207 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.594337 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.594515 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.594640 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.594818 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.594946 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.595128 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.595253 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.595429 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.595554 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.595732 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.595861 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.596039 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.596193 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.596399 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.596556 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.596695 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.596819 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.596949 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.597080 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.597258 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.597385 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.597579 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.597712 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.597893 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.598020 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.598201 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.598340 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.598553 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.598686 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.598964 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.599299 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.599426 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.599609 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.599737 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.599935 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.600063 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.600247 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.600379 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.600591 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.600720 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.600900 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.601024 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.601206 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.601340 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.601508 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.601642 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.601810 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.601939 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.602115 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.602255 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.602426 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.602553 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.602729 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.602856 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.603032 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.603251 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.603477 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.603637 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.603762 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.603884 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.603996 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.604132 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.604246 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.604548 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.604675 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.604869 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.604997 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.605180 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.605309 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.605488 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.605616 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.605794 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.605933 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.606136 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.606266 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.606440 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.606566 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.606766 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.606900 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.607094 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.607223 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.607412 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.607538 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.607717 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.607853 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.608031 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.608158 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.608339 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.608482 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.608672 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.608809 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.608978 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.609112 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.609287 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.609412 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.609590 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.609717 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.609899 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.610035 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.610207 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.610341 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.610509 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.610636 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.610816 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.610950 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.611135 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.611260 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.611443 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.611570 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.611748 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.611875 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.612048 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.612181 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.612353 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.612525 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.612712 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.612838 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.613026 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.613164 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.613349 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.613490 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.613672 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.613799 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.613984 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.614112 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.614976 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.615433 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.615572 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.615721 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.615856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.616041 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.616161 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.616354 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.616499 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.616696 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.616834 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.617010 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.617137 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.617320 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.617452 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.617636 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.617763 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.617944 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.618078 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.618258 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.618386 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.618563 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.618698 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.618882 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.619008 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.619185 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.619313 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.619493 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.619628 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.619813 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.619948 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.620140 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.620277 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.620483 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.620629 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.620783 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.620923 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.621104 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.621239 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.621415 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.621551 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.621724 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.621852 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.622035 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.622161 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.622336 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.622462 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.622639 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.622766 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.622949 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.623076 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.623262 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.623390 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.623571 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.623706 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.623880 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.624008 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.624183 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.624310 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.624522 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.624651 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.624834 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.624960 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.625139 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.625269 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.625443 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.625570 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.625754 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.625896 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.626073 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.626209 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.626381 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.626508 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.626700 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.626835 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.627016 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.627151 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.627316 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.627441 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.627618 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.627754 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.627936 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.628069 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.628241 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.628366 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.628587 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.628730 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.628856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.628978 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.629144 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.629274 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.629469 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.629604 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.629851 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.630549 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.630770 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.630897 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.631034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.631252 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.631379 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.631564 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.631698 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.631878 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.632019 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.632189 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.632316 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.632520 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.632651 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.632842 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.632980 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.633154 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.633289 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.633461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.633595 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.633773 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.633992 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.634119 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.634241 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.634385 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.634514 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.634692 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.634828 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.635008 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.635134 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.635316 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.635443 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.635620 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.635746 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.635926 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.636052 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.636230 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.636349 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.636564 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.636703 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.636928 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.637063 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.637187 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.637454 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.637592 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.637785 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.637912 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.638095 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.638229 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.638409 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.638536 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.638719 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.638853 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.639031 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.639157 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.639352 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.639478 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.639668 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.639797 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.639979 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.640114 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.640287 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.640426 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.640620 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.640750 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.640924 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.641061 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.641228 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.641364 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.641538 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.641666 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.641841 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.641967 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.642145 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.642281 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.642450 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.642570 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.642755 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.642881 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.643056 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.643182 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.643358 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.643485 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.643658 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.643930 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.644071 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.644260 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.644380 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.644585 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.644713 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.644897 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.645037 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.645200 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.645334 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.645578 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.645717 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.645892 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.646233 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.646370 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.646576 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.646703 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.646918 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.647061 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.647227 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.647367 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.647543 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.647670 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.647855 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.647983 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.648166 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.648302 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.648504 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.648635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.648816 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.648952 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.649123 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.649252 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.649430 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.649556 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.649738 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.649864 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.650042 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.650179 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.650345 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.650480 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.650650 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.650776 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.650954 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.651080 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.651255 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.651382 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.651560 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.651685 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.651865 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.651992 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.652170 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.652297 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.652497 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.652637 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.652801 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.652929 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.653109 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.653245 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.653409 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.653545 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.653711 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.653845 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.654016 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.654149 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.654324 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.654461 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.654624 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.654763 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.654933 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.655055 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.655238 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.655374 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.655539 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.655667 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.655848 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.655976 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.656149 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.656285 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.656482 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.656625 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.656787 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.656915 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.657088 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.657217 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.657388 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.657517 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.657694 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.657829 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.658030 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.658155 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.658277 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.658407 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.658586 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.658713 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.658891 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.659017 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.659192 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.659319 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.659493 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.659629 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.659797 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.659922 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.660098 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.660226 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.660398 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.660575 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.660728 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.660856 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.661570 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.661712 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.662042 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.662177 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.662484 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.662611 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.662805 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.662932 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.663116 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.663250 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.663423 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.663551 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.663726 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.663861 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.664035 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.664171 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.664339 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.664503 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.664661 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.664798 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.664965 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.665093 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.665266 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.665391 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.665569 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.665706 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.665872 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.665999 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.666185 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.666309 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.666486 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.666621 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.666790 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.666917 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.667087 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.667211 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.667395 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.667534 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.667702 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.667830 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.668009 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.668136 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.668322 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.668516 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.668673 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.668798 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.668990 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.669116 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.669297 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.669440 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.669605 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.669730 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.669908 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.670034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.670207 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.670340 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.670510 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.670645 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.670816 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.670948 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.671119 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.671254 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.671416 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.671542 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.671719 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.671846 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.672021 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.672149 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.672328 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.672488 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.672659 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.672784 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.672977 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.673106 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.673287 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.673413 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.673595 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.673730 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.673895 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.674021 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.674202 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.674338 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.674511 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.674647 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.674823 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.674958 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.675130 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.675265 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.675438 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.675583 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.675746 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.675873 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.676057 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.676184 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.676367 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.676539 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.677326 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.677508 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.677818 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.678101 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.678230 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.678363 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.678545 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.678673 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.678866 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.678979 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.679176 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.679289 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.679484 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.679597 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.679801 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.679922 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.680107 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.680222 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.680416 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.680577 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.680742 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.680869 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.681054 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.681183 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.681357 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.681484 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.681680 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.682052 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.682247 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.682382 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.682558 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.682687 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.682868 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.683000 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.683181 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.683315 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.683499 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.683626 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.683812 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.683946 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.684121 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.684254 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.684418 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.684563 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.684756 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.684898 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.685069 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.685197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.685379 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.685507 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.685692 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.685833 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.686005 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.686132 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.686312 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.686447 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.686626 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.686752 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.686935 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.687068 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.687235 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.687368 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.687538 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.687673 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.687835 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.687968 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.688137 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.688262 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.688515 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.688650 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.688775 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.688904 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.689161 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.689295 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.689468 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.689595 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.689771 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.689896 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.690084 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.690217 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.690397 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.690524 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.690714 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.690847 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.691032 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.691168 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.691340 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.691466 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.691685 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.691810 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.691989 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.692131 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.692355 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.692712 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.692844 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.693032 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.693208 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.693348 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.693473 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.693648 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.693783 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.693963 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.694099 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.694267 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.694402 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.694587 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.694715 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.694894 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.695028 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.695204 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.695332 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.695527 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.695651 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.695832 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.695969 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.696155 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.696292 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.696569 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.696701 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.696889 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.697010 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.697211 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.697350 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.697513 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.697650 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.697814 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.697941 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.698122 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.698259 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.698426 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.698553 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.698729 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.698857 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.699055 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.699182 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.699337 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.699466 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.699646 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.699781 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.699955 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.700083 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.700262 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.700389 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.700589 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.700718 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.700894 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.701038 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.701215 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.701351 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.701516 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.701643 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.701835 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.701976 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.702146 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.702273 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.702465 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.702633 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.702784 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.702920 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.703090 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.703282 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.703415 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.703547 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.703705 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.703839 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.704007 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.704133 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.704310 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.704477 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.704638 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.704764 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.704979 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.705114 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.705356 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.705490 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.705666 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.705801 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.705975 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.706102 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.706302 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.706430 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.706610 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.706743 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.706924 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.707050 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.707238 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.707365 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.707552 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.707677 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.708002 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.708290 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.708429 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.708627 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.708753 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.708997 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.709122 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.709324 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.709542 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.709813 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.710090 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.710624 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.711135 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.711271 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.711578 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.712125 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.712697 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.713044 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.713173 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.713403 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.713601 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.713764 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.714182 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.714714 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.715216 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.715361 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.715557 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.715724 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.715894 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.716051 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.716222 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.716415 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.716621 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.716954 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.717080 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.717295 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.717588 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.717717 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.717916 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.718045 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.718261 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.718397 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.718586 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.718715 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.718921 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.719048 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.719247 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.719375 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.719570 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.719696 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.719894 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.720022 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.720204 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.720330 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.720543 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.720666 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.720862 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.721000 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.721170 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.721305 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.721480 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.721615 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.721788 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.721922 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.722104 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.722244 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.722414 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.722544 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.722977 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.723127 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.723254 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.723463 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.724134 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.724377 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.724544 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.724726 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.725047 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.725182 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.725373 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.725500 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.725693 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.725822 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.726010 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.726142 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.726325 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.726452 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.726676 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.726812 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.726989 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.727116 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.727319 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.727452 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.727637 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.727765 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.727960 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.728087 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.728280 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.728406 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.728627 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.728766 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.728944 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.729080 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.729260 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.729388 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.729573 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.729714 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.729893 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.730020 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.730217 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.730345 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.730523 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.730650 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.730837 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.730974 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.731151 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.731279 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.731466 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.731594 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.731778 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.732010 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.732146 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.732343 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.732520 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.732693 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.732820 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.733006 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.733132 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.733317 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.733523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.733650 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.733773 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.733930 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.734060 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.734243 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.734377 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.734560 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.734687 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.734874 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.735003 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.735182 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.735309 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.735501 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.735629 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.735815 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.735942 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.736141 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.736332 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.736504 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.736689 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.736817 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.737023 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.737152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.737346 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.737474 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.737671 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.737799 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.737986 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.738115 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.738302 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.738429 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.738626 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.738753 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.738930 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.739059 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.739275 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.739936 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.740086 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.740398 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.740585 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.740733 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.740862 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.741054 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.741182 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.741366 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.741495 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.741670 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.741808 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.741989 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.742117 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.742299 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.742431 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.742665 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.742830 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.742987 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.743178 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.743307 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.743495 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.743644 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.743821 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.743970 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.744146 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.744275 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.744492 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.744635 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.744803 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.744931 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.745125 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.745438 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.745567 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.745741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.745880 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.746053 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.746197 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.746362 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.746489 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.746666 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.746794 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.746970 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.747099 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.747281 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.747423 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.747590 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.747719 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.747893 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.748022 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.748202 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.748329 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.748525 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.748656 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.748846 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.748974 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.749150 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.749282 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.749450 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.749578 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.749755 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.749884 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.750062 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.750189 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.750363 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.750502 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.750664 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.750800 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.750965 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.751207 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.751336 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.751561 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.751688 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.751863 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.751991 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.752170 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.752298 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.752496 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.752628 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.752809 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.752946 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.753111 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.753238 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.753419 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.753555 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.753722 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.753850 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.754041 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.754179 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.754342 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.754477 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.754658 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.754822 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.755119 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.755338 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.755503 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.755671 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.755797 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.755999 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.756135 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.756311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.756466 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.756649 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.756788 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.756956 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.757082 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.757291 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.757420 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.757604 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.757823 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.757959 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.758160 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.758290 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.758482 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.758610 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.758804 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.758930 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.759113 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.759243 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.759422 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.759549 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.759725 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.759860 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.760030 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.760160 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.760336 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.760487 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.760679 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.760810 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.760990 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.761111 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.761299 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.761425 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.761604 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.761743 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.761911 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.762037 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.762216 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.762343 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.762525 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.762659 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.762834 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.762962 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.763144 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.763271 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.763453 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.763655 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.763782 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.763912 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.764057 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.764185 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.764364 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.764511 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.764711 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.764840 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.765025 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.765159 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.765368 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.765499 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.765688 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.765899 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.766027 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.766234 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.766374 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.766560 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.766688 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.766896 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.767024 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.767200 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.767334 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.767509 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.767638 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.767815 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.767943 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.768123 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.768250 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.768491 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.768623 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.768777 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.768904 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.769082 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.769218 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.769395 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.769520 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.769711 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.769840 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.770026 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.770155 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.770339 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.770781 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.770930 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.771070 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.771291 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.771430 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.771625 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.771755 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.771940 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.772079 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.772265 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.772396 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.772602 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.772731 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.772919 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.773064 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.773239 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.773367 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.773563 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.773692 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.773883 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.774011 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.774190 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.774317 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.774495 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.774623 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.774797 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.774927 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.775105 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.775232 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.775426 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.775554 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.775736 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.775873 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.776041 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.776169 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.776343 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.776508 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.776678 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.776807 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.776984 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.777112 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.777289 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.777427 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.777591 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.777719 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.777893 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.778028 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.778201 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.778342 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.778503 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.778638 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.778804 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.778931 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.779106 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.779243 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.779407 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.779548 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.779707 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.779834 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.780136 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.780317 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.780466 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.780641 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.780769 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.780944 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.781080 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.781245 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.781454 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.781590 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.781746 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.781884 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.782075 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.782204 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.782386 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.782514 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.782696 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.782825 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.783005 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.783132 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.783320 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.783448 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.783641 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.783777 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.783954 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.784079 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.784257 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.784392 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.784602 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.784730 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.784916 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.785041 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.785222 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.785356 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.785531 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.785659 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.785838 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.785966 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.786768 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.786917 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.787185 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.787319 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.787504 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.787633 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.787821 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.787949 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.788139 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.788266 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.788494 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.788640 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.788827 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.788964 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.789136 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.789265 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.789448 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.789574 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.789759 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.789904 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.790071 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.790198 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.790378 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.790505 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.790686 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.790815 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.790994 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.791129 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.791307 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.791434 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.791619 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.791756 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.791929 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.792057 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.792242 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.792369 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.792577 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.792714 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.792894 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.793023 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.793204 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.793407 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.793542 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.793674 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.793805 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.793929 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.794110 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.794246 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.794433 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.794570 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.794757 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.794888 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.795066 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.795202 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.795379 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.795505 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.795695 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.795823 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.796010 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.796147 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.796327 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.796516 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.796702 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.796829 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.796972 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.797098 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.797297 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.797430 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.797603 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.797729 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.797906 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.798026 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.798148 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 19:05:14.798271 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.798547 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.798868 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.799184 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.799517 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.799831 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.800147 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.800480 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.800799 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.801115 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.801433 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.802421 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.803029 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.803325 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.803695 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.804032 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.804369 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.804716 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.805051 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.805385 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.805739 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.806058 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.806408 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.806742 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.807326 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.807647 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.807958 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:05:14.808206 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 19:05:14.954388 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO dbcounter [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Registered counter for database nova_api Aug 09 19:05:14.965211 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO dbcounter [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Registered counter for database nova_api Aug 09 19:05:14.976680 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_db.sqlalchemy.engines [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:05:14.983194 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writer thread running {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:05:14.985404 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_db.sqlalchemy.engines [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:05:14.992932 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writer thread running {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:05:15.040138 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.context [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00066696-20f3-4c56-9a74-e60e6ce0ffd8(cell1) {{(pid=103311) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 19:05:15.044009 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_concurrency.lockutils [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:15.044511 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_concurrency.lockutils [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:15.046077 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_concurrency.lockutils [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:15.046805 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_concurrency.lockutils [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:15.047251 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_concurrency.lockutils [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:15.049251 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_concurrency.lockutils [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103311) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:15.049447 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.context [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00066696-20f3-4c56-9a74-e60e6ce0ffd8(cell1) {{(pid=103312) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 19:05:15.051231 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO dbcounter [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Registered counter for database nova_cell0 Aug 09 19:05:15.054329 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:15.054804 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:15.056384 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:15.057404 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:05:15.057531 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO dbcounter [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Registered counter for database nova_cell1 Aug 09 19:05:15.057852 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:05:15.059850 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:05:15.061879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO dbcounter [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Registered counter for database nova_cell0 Aug 09 19:05:15.064758 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_db.sqlalchemy.engines [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:05:15.067044 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_db.sqlalchemy.engines [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:05:15.068781 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO dbcounter [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Registered counter for database nova_cell1 Aug 09 19:05:15.072551 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writer thread running {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:05:15.075857 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_db.sqlalchemy.engines [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:05:15.076214 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writer thread running {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:05:15.079217 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_db.sqlalchemy.engines [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:05:15.082114 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writer thread running {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:05:15.221300 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO dbcounter [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Registered counter for database nova_cell0 Aug 09 19:05:15.230261 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writer thread running {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:05:15.231093 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG oslo_db.sqlalchemy.engines [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:05:15.235403 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writer thread running {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:05:15.239186 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO dbcounter [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Registered counter for database nova_cell0 Aug 09 19:05:15.248519 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_db.sqlalchemy.engines [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:05:15.253254 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writer thread running {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:05:15.579678 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: WARNING keystonemiddleware.auth_token [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 19:05:15.580325 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: WARNING keystonemiddleware.auth_token [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 19:05:15.586823 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: WARNING keystonemiddleware.auth_token [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 19:05:15.587074 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: WARNING keystonemiddleware.auth_token [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 19:05:15.943064 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: WARNING keystonemiddleware.auth_token [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 19:05:15.943870 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: WARNING keystonemiddleware.auth_token [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 19:05:15.949211 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: WARNING keystonemiddleware.auth_token [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 19:05:15.949744 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: WARNING keystonemiddleware.auth_token [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 19:05:15.954430 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d99a7cb9c0 pid: 103311 (default app) Aug 09 19:05:15.954902 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d99a7cb9c0 pid: 103312 (default app) Aug 09 19:05:15.956473 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:05:15.957656 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-cb27bd0d-d059-4530-be1e-a8fcf662fd4a None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Aug 09 19:05:15.958104 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Tue Aug 9 19:05:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:33.056361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:33.057813 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002485 Aug 09 19:06:33.058443 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:33.070785 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writing DB stats nova_api:SELECT=3 {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:06:33.071841 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writing DB stats nova_cell1:SELECT=3 {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:06:33.072869 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writing DB stats nova_cell0:SELECT=3 {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:06:33.073612 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:06:33.963297 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-a11552fd-c71d-4972-a4da-b16c18bfd078 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:33.996066 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-a11552fd-c71d-4972-a4da-b16c18bfd078 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.931478 Aug 09 19:06:33.996861 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1292 bytes} [Tue Aug 9 19:06:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:36.240962 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:36.241971 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-36ae2b39-b726-4de9-9341-a38220147b19 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 09 19:06:36.242369 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 2/4] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:36.750173 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-ca44e762-78c4-4d92-850d-c6ba87480edf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:36.771268 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:06:36.771268 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: warnings.warn(msg) Aug 09 19:06:36.801613 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-ca44e762-78c4-4d92-850d-c6ba87480edf admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.552964 Aug 09 19:06:36.802958 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 3/5] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:06:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:06:37.026450 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-8429c2e1-789b-4906-bd99-c6722f40042a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:37.030863 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:06:37.030863 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: warnings.warn(msg) Aug 09 19:06:37.033551 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_api:SELECT=3 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:06:37.034422 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_cell0:SELECT=3 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:06:37.035445 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_cell1:SELECT=3 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:06:37.036190 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_cell0:SELECT=3 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:06:37.103481 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-8429c2e1-789b-4906-bd99-c6722f40042a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292681 Aug 09 19:06:37.104006 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 3/6] 10.222.0.70 () {64 vars in 1336 bytes} [Tue Aug 9 19:06:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:39.683306 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-ca44e762-78c4-4d92-850d-c6ba87480edf admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:39.684309 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-ca44e762-78c4-4d92-850d-c6ba87480edf admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 09 19:06:39.684755 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 4/7] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:40.366922 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-02936418-da4d-4285-8b60-1a2e042ee87f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "ram": 512}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:40.386926 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:06:40.386926 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: warnings.warn(msg) Aug 09 19:06:40.409135 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-02936418-da4d-4285-8b60-1a2e042ee87f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.718228 Aug 09 19:06:40.417092 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 4/8] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:06:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:06:40.422368 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-c306658f-c575-44e9-a2b1-1d58540cee7e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:40.425592 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:06:40.425592 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: warnings.warn(msg) Aug 09 19:06:40.461945 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-c306658f-c575-44e9-a2b1-1d58540cee7e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043127 Aug 09 19:06:40.463091 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 5/9] 10.222.0.70 () {64 vars in 1336 bytes} [Tue Aug 9 19:06:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:42.684179 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-02936418-da4d-4285-8b60-1a2e042ee87f admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:42.685426 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-02936418-da4d-4285-8b60-1a2e042ee87f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001687 Aug 09 19:06:42.686093 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:43.089884 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-0da394ad-5a6d-4e7c-bd24-8ee0dbb69b52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "name": "ds1G"}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:43.110376 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-0da394ad-5a6d-4e7c-bd24-8ee0dbb69b52 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.417778 Aug 09 19:06:43.110852 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 6/11] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:06:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 19:06:43.122864 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-a0f4ff4a-bc72-4964-a833-95f1660e3498 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:43.147906 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-a0f4ff4a-bc72-4964-a833-95f1660e3498 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028644 Aug 09 19:06:43.148497 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 6/12] 10.222.0.70 () {64 vars in 1336 bytes} [Tue Aug 9 19:06:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:45.394663 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-0da394ad-5a6d-4e7c-bd24-8ee0dbb69b52 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:45.396370 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-0da394ad-5a6d-4e7c-bd24-8ee0dbb69b52 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002489 Aug 09 19:06:45.397179 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 7/13] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:45.830907 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-41c8311d-bcdd-405f-baa6-83b42dd2e1c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "disk": 10}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:45.853864 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-41c8311d-bcdd-405f-baa6-83b42dd2e1c7 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.446649 Aug 09 19:06:45.860825 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 7/14] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:06:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:06:45.869642 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-657d6f95-1f04-484d-b333-3a78e02bda9c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:45.901452 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-657d6f95-1f04-484d-b333-3a78e02bda9c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035178 Aug 09 19:06:45.902252 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 8/15] 10.222.0.70 () {64 vars in 1336 bytes} [Tue Aug 9 19:06:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:48.160219 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-41c8311d-bcdd-405f-baa6-83b42dd2e1c7 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:48.161283 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-41c8311d-bcdd-405f-baa6-83b42dd2e1c7 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Aug 09 19:06:48.161670 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 8/16] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:48.598207 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-fd699516-2d1c-4184-8f03-57bc1cf3b2b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:48.617241 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-fd699516-2d1c-4184-8f03-57bc1cf3b2b8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449735 Aug 09 19:06:48.617996 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 9/17] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:06:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 19:06:48.630035 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-46d21e50-1f16-4d0c-b65c-65e0dafccb88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:48.654765 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-46d21e50-1f16-4d0c-b65c-65e0dafccb88 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028816 Aug 09 19:06:48.655567 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 9/18] 10.222.0.70 () {64 vars in 1336 bytes} [Tue Aug 9 19:06:48 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:50.952458 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-fd699516-2d1c-4184-8f03-57bc1cf3b2b8 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:50.953474 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-fd699516-2d1c-4184-8f03-57bc1cf3b2b8 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 09 19:06:50.953882 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 10/19] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:51.385326 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-18577d79-14e7-4575-8a34-778a3c39d43a admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:51.413278 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-18577d79-14e7-4575-8a34-778a3c39d43a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452128 Aug 09 19:06:51.413909 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 10/20] 10.222.0.70 () {60 vars in 1292 bytes} [Tue Aug 9 19:06:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:06:53.703890 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-fd699516-2d1c-4184-8f03-57bc1cf3b2b8 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:53.704942 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-fd699516-2d1c-4184-8f03-57bc1cf3b2b8 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 09 19:06:53.705350 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 11/21] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:54.160714 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-c7820e5a-11d0-4274-aaa8-13e9fc8dc0e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "swap": 0, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:54.183275 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-c7820e5a-11d0-4274-aaa8-13e9fc8dc0e4 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.470781 Aug 09 19:06:54.183975 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 11/22] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:06:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:06:54.196579 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-a6cd7800-b2fa-4ee7-9089-3ff82940238a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:54.222549 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-a6cd7800-b2fa-4ee7-9089-3ff82940238a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029174 Aug 09 19:06:54.223247 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 12/23] 10.222.0.70 () {64 vars in 1333 bytes} [Tue Aug 9 19:06:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:56.584403 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-c7820e5a-11d0-4274-aaa8-13e9fc8dc0e4 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:56.585445 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-c7820e5a-11d0-4274-aaa8-13e9fc8dc0e4 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Aug 09 19:06:56.585844 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 12/24] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:56.994672 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-920f774c-dae8-4a44-b03c-df2606be148b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "id": "2", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:57.013689 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-920f774c-dae8-4a44-b03c-df2606be148b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421680 Aug 09 19:06:57.014193 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 13/25] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:06:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:06:57.026902 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-f79cb231-bc46-44fe-97e1-66720c774727 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:57.050718 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-f79cb231-bc46-44fe-97e1-66720c774727 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027503 Aug 09 19:06:57.051299 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 13/26] 10.222.0.70 () {64 vars in 1333 bytes} [Tue Aug 9 19:06:57 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:06:59.316327 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-920f774c-dae8-4a44-b03c-df2606be148b admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:06:59.317403 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-920f774c-dae8-4a44-b03c-df2606be148b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Aug 09 19:06:59.317804 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 14/27] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:06:59.709886 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-52fca861-dfd5-45cc-a1b7-fafb2954e620 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:59.730832 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-52fca861-dfd5-45cc-a1b7-fafb2954e620 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.404225 Aug 09 19:06:59.731391 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 14/28] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:06:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:06:59.744339 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-1afa24e0-25e0-483a-9a81-f586994a76ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:06:59.779509 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-1afa24e0-25e0-483a-9a81-f586994a76ba admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038640 Aug 09 19:06:59.780720 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 15/29] 10.222.0.70 () {64 vars in 1333 bytes} [Tue Aug 9 19:06:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:07:02.106626 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-52fca861-dfd5-45cc-a1b7-fafb2954e620 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:02.107837 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-52fca861-dfd5-45cc-a1b7-fafb2954e620 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001810 Aug 09 19:07:02.108375 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 15/30] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:02.538401 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-cab14eca-07d4-4a54-931b-4797630d4157 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "swap": 0, "id": "4", "rxtx_factor": 1.0}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:07:02.562490 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-cab14eca-07d4-4a54-931b-4797630d4157 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.446882 Aug 09 19:07:02.563163 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 16/31] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:07:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:07:02.575077 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-75d61b02-b0b4-4895-84d3-2da0374a4f47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:07:02.599536 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-75d61b02-b0b4-4895-84d3-2da0374a4f47 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028016 Aug 09 19:07:02.600118 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 16/32] 10.222.0.70 () {64 vars in 1333 bytes} [Tue Aug 9 19:07:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:07:04.894811 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-cab14eca-07d4-4a54-931b-4797630d4157 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:04.895834 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-cab14eca-07d4-4a54-931b-4797630d4157 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 09 19:07:04.896240 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 17/33] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:07:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:07:05.332529 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-a3d5d30a-ccac-4ba6-a45a-5da6d18a87b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:07:05.355939 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-a3d5d30a-ccac-4ba6-a45a-5da6d18a87b7 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453405 Aug 09 19:07:05.356527 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 17/34] 10.222.0.70 () {64 vars in 1283 bytes} [Tue Aug 9 19:07:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:07:05.369096 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-5104866c-482d-4e0d-a1f8-3437f957bb0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:07:05.374105 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:07:05.401566 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-5104866c-482d-4e0d-a1f8-3437f957bb0c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035938 Aug 09 19:07:05.402150 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 18/35] 10.222.0.70 () {64 vars in 1333 bytes} [Tue Aug 9 19:07:05 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:07:25.555615 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-a3d5d30a-ccac-4ba6-a45a-5da6d18a87b7 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:25.556653 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-a3d5d30a-ccac-4ba6-a45a-5da6d18a87b7 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001681 Aug 09 19:07:25.557049 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 18/36] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:07:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:25.960229 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-2de7f508-f550-430b-bcb8-bcfc80390085 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:25.978646 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-2de7f508-f550-430b-bcb8-bcfc80390085 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415490 Aug 09 19:07:25.979122 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 19/37] 10.222.0.70 () {60 vars in 1292 bytes} [Tue Aug 9 19:07:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:07:27.050997 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-a3d5d30a-ccac-4ba6-a45a-5da6d18a87b7 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:27.052069 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-a3d5d30a-ccac-4ba6-a45a-5da6d18a87b7 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Aug 09 19:07:27.052492 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 19/38] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:07:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:27.574367 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-bd17026f-a746-402a-9ca2-5dd9764c56f6 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:27.579990 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.wsgi [None req-bd17026f-a746-402a-9ca2-5dd9764c56f6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-bd17026f-a746-402a-9ca2-5dd9764c56f6 admin admin] Request method failure captured: Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Accept: application/json Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Accept-Encoding: gzip, deflate Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Connection: keep-alive Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Content-Length: 0 Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Host: 10.222.0.70 Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Openstack-Api-Version: compute 2.90 Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Openstack-System-Scope: None Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: User-Agent: python-novaclient Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Auth-Token: gAAAAABi8rBudjV3ycl-1pogotBL1n1E5EljvIpzArQggp3BpHibxiGwLwl2JI7sZ6yjq6B9X2ej6NzN461aNtud7EoMH4cmr4tIFRvtLTIW_MMi0CxyLAIvFt3fktCdWr2YO9ArBTgDWIoqNR-kqiiYGvRsyDjlPL8K8SzacV4zr-qq701FOoc Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Domain-Id: None Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Domain-Name: None Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Identity-Status: Confirmed Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Is-Admin-Project: True Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Domain-Id: default Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Domain-Name: Default Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Name: admin Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Role: admin,reader,member Aug 09 19:07:27.583635 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Roles: admin,reader,member Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de422168330743c9990b96b3dab6b6f7"}]}] Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Tenant: admin Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Tenant-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Tenant-Name: admin Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User: admin Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Domain-Id: default Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Domain-Name: Default Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Id: 910b0103ce4a49babfe0b9390ae4fdd2 Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Name: admin Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: method: > Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: exception: Flavor 42 could not be found. Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: action_args: {'id': '42'} Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:07:27.585126 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:27.586034 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.587461 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-bd17026f-a746-402a-9ca2-5dd9764c56f6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:07:27.588911 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-bd17026f-a746-402a-9ca2-5dd9764c56f6 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.395401 Aug 09 19:07:27.588911 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 20/39] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Aug 9 19:07:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 19:07:27.594739 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-9783aec4-0ed6-42c9-87a8-63879448880d admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:27.599319 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:07:27.619678 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-9783aec4-0ed6-42c9-87a8-63879448880d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028490 Aug 09 19:07:27.620226 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 20/40] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Aug 9 19:07:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:07:27.630091 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-2444710c-95fe-4c2e-8578-a6562b484ab0 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:27.653911 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-2444710c-95fe-4c2e-8578-a6562b484ab0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027549 Aug 09 19:07:27.654457 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 21/41] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Aug 9 19:07:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:07:27.664322 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-a9e91ff2-b01e-433d-882a-6ee1aceafdf7 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:27.670601 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.wsgi [None req-a9e91ff2-b01e-433d-882a-6ee1aceafdf7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-a9e91ff2-b01e-433d-882a-6ee1aceafdf7 admin admin] Request method failure captured: Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Accept: application/json Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Accept-Encoding: gzip, deflate Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Connection: keep-alive Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Content-Length: 0 Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Host: 10.222.0.70 Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Openstack-Api-Version: compute 2.90 Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Openstack-System-Scope: None Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: User-Agent: python-novaclient Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Auth-Token: gAAAAABi8rBudjV3ycl-1pogotBL1n1E5EljvIpzArQggp3BpHibxiGwLwl2JI7sZ6yjq6B9X2ej6NzN461aNtud7EoMH4cmr4tIFRvtLTIW_MMi0CxyLAIvFt3fktCdWr2YO9ArBTgDWIoqNR-kqiiYGvRsyDjlPL8K8SzacV4zr-qq701FOoc Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Domain-Id: None Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Domain-Name: None Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Identity-Status: Confirmed Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Is-Admin-Project: True Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Domain-Id: default Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Domain-Name: Default Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Name: admin Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Role: admin,reader,member Aug 09 19:07:27.673835 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Roles: admin,reader,member Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de422168330743c9990b96b3dab6b6f7"}]}] Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Tenant: admin Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Tenant-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Tenant-Name: admin Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User: admin Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Domain-Id: default Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Domain-Name: Default Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Id: 910b0103ce4a49babfe0b9390ae4fdd2 Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Name: admin Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: method: > Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: exception: Flavor 42 could not be found. Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: action_args: {'id': '42'} Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:07:27.675151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:27.676879 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:27.678143 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-a9e91ff2-b01e-433d-882a-6ee1aceafdf7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:07:27.679362 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-a9e91ff2-b01e-433d-882a-6ee1aceafdf7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014524 Aug 09 19:07:27.679362 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 21/42] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Aug 9 19:07:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 19:07:28.658303 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-2444710c-95fe-4c2e-8578-a6562b484ab0 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:28.659318 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-2444710c-95fe-4c2e-8578-a6562b484ab0 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 09 19:07:28.660381 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 22/43] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:07:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:29.190049 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-05e6e092-3de8-48cf-8a27-270a587c19cd admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:29.196841 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.wsgi [None req-05e6e092-3de8-48cf-8a27-270a587c19cd admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-05e6e092-3de8-48cf-8a27-270a587c19cd admin admin] Request method failure captured: Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Accept: application/json Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Accept-Encoding: gzip, deflate Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Connection: keep-alive Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Content-Length: 0 Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Host: 10.222.0.70 Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Openstack-Api-Version: compute 2.90 Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Openstack-System-Scope: None Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: User-Agent: python-novaclient Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Auth-Token: gAAAAABi8rBwgYk6T6VDOKIZpcHVJDjNeUuP3apW2Iuryg8AEh7i16ER8nOPN_HHQOesTojnfFy46tVwTjhZJbxCMpnoy9r3C_5nToPUe3buZTA1tb3EUs8w7n558B1JOxtyta80FlOyawzFsVjfXCaTLdNQRxz9O8us4ZQGtqrbg-MKZ0s_Mss Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Domain-Id: None Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Domain-Name: None Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Identity-Status: Confirmed Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Is-Admin-Project: True Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Domain-Id: default Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Domain-Name: Default Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Name: admin Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Role: admin,reader,member Aug 09 19:07:29.198361 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Roles: admin,reader,member Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de422168330743c9990b96b3dab6b6f7"}]}] Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Tenant: admin Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Tenant-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Tenant-Name: admin Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User: admin Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Domain-Id: default Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Domain-Name: Default Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Id: 910b0103ce4a49babfe0b9390ae4fdd2 Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Name: admin Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: method: > Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: exception: Flavor 84 could not be found. Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: action_args: {'id': '84'} Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:07:29.199842 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:29.200814 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.202103 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-05e6e092-3de8-48cf-8a27-270a587c19cd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:07:29.203393 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-05e6e092-3de8-48cf-8a27-270a587c19cd admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398792 Aug 09 19:07:29.203393 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 22/44] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Aug 9 19:07:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 19:07:29.209637 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-7b7a840c-9828-43d3-a758-43d2532b96b0 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:29.224626 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-7b7a840c-9828-43d3-a758-43d2532b96b0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018641 Aug 09 19:07:29.225167 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 23/45] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Aug 9 19:07:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:07:29.234646 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-3f26059c-762b-4682-a2c3-2c7ce79873c9 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:29.251819 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-3f26059c-762b-4682-a2c3-2c7ce79873c9 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020729 Aug 09 19:07:29.252333 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Aug 9 19:07:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:07:29.262249 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-8d05211d-fbc3-4d38-a427-354ca929f2cd admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:29.268651 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.wsgi [None req-8d05211d-fbc3-4d38-a427-354ca929f2cd admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-8d05211d-fbc3-4d38-a427-354ca929f2cd admin admin] Request method failure captured: Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Accept: application/json Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Accept-Encoding: gzip, deflate Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Connection: keep-alive Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Content-Length: 0 Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Host: 10.222.0.70 Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Openstack-Api-Version: compute 2.90 Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Openstack-System-Scope: None Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: User-Agent: python-novaclient Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Auth-Token: gAAAAABi8rBwgYk6T6VDOKIZpcHVJDjNeUuP3apW2Iuryg8AEh7i16ER8nOPN_HHQOesTojnfFy46tVwTjhZJbxCMpnoy9r3C_5nToPUe3buZTA1tb3EUs8w7n558B1JOxtyta80FlOyawzFsVjfXCaTLdNQRxz9O8us4ZQGtqrbg-MKZ0s_Mss Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Domain-Id: None Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Domain-Name: None Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Identity-Status: Confirmed Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Is-Admin-Project: True Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Domain-Id: default Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Domain-Name: Default Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Name: admin Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Role: admin,reader,member Aug 09 19:07:29.270197 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Roles: admin,reader,member Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de422168330743c9990b96b3dab6b6f7"}]}] Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Tenant: admin Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Tenant-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Tenant-Name: admin Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User: admin Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Domain-Id: default Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Domain-Name: Default Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Id: 910b0103ce4a49babfe0b9390ae4fdd2 Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Name: admin Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: method: > Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: exception: Flavor 84 could not be found. Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: action_args: {'id': '84'} Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:07:29.271741 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:29.272693 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:29.273831 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-8d05211d-fbc3-4d38-a427-354ca929f2cd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:07:29.274847 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-8d05211d-fbc3-4d38-a427-354ca929f2cd admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012984 Aug 09 19:07:29.274847 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 24/47] 10.222.0.70 () {60 vars in 1190 bytes} [Tue Aug 9 19:07:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 19:07:30.234459 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-3f26059c-762b-4682-a2c3-2c7ce79873c9 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:30.235532 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-3f26059c-762b-4682-a2c3-2c7ce79873c9 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 09 19:07:30.235927 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 24/48] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:07:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:30.753599 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-593c3d77-f34b-48c3-a556-0a3b8d73e25c admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:30.759664 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.wsgi [None req-593c3d77-f34b-48c3-a556-0a3b8d73e25c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-593c3d77-f34b-48c3-a556-0a3b8d73e25c admin admin] Request method failure captured: Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Accept: application/json Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Accept-Encoding: gzip, deflate Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Connection: keep-alive Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Content-Length: 0 Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Host: 10.222.0.70 Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Openstack-Api-Version: compute 2.90 Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Openstack-System-Scope: None Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: User-Agent: python-novaclient Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Auth-Token: gAAAAABi8rBy74E1qfstMiy9jxMcRRPwQzQRNzpLymk6gvAzbwH4Vjy6Nqb8lqESEHp_cQFdREdqnAK_wr2F-mjmDdLFt2zT5ozJXXoU-9Gny8mepNw0U4mtCiKpqbZUi7Lj-QldYqhztodxFYtEfPNCjhw22Ccg-Ka2qfy-0nu-8AGJAV1mFuI Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Domain-Id: None Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Domain-Name: None Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Identity-Status: Confirmed Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Is-Admin-Project: True Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Domain-Id: default Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Domain-Name: Default Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Project-Name: admin Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Role: admin,reader,member Aug 09 19:07:30.761218 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Roles: admin,reader,member Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de422168330743c9990b96b3dab6b6f7"}]}] Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Tenant: admin Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Tenant-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-Tenant-Name: admin Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User: admin Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Domain-Id: default Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Domain-Name: Default Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Id: 910b0103ce4a49babfe0b9390ae4fdd2 Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: X-User-Name: admin Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: method: > Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: exception: Flavor 451 could not be found. Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: action_args: {'id': '451'} Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:07:30.762856 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:30.763723 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.765097 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-593c3d77-f34b-48c3-a556-0a3b8d73e25c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103311) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:07:30.766335 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-593c3d77-f34b-48c3-a556-0a3b8d73e25c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390682 Aug 09 19:07:30.766335 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 25/49] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Aug 9 19:07:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 19:07:30.772906 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-088c01c1-57ab-41b6-baf5-505aa06b1689 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:30.788380 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-088c01c1-57ab-41b6-baf5-505aa06b1689 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019733 Aug 09 19:07:30.788936 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 25/50] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Aug 9 19:07:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:07:30.798278 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:30.813277 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018483 Aug 09 19:07:30.813815 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 26/51] 10.222.0.70 () {60 vars in 1210 bytes} [Tue Aug 9 19:07:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:07:30.823326 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-1ba1fe29-4234-4159-85ff-b4a1b19930e7 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:30.828673 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.wsgi [None req-1ba1fe29-4234-4159-85ff-b4a1b19930e7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-1ba1fe29-4234-4159-85ff-b4a1b19930e7 admin admin] Request method failure captured: Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Accept: application/json Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Accept-Encoding: gzip, deflate Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Connection: keep-alive Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Content-Length: 0 Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Host: 10.222.0.70 Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Openstack-Api-Version: compute 2.90 Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Openstack-System-Scope: None Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: User-Agent: python-novaclient Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Auth-Token: gAAAAABi8rBy74E1qfstMiy9jxMcRRPwQzQRNzpLymk6gvAzbwH4Vjy6Nqb8lqESEHp_cQFdREdqnAK_wr2F-mjmDdLFt2zT5ozJXXoU-9Gny8mepNw0U4mtCiKpqbZUi7Lj-QldYqhztodxFYtEfPNCjhw22Ccg-Ka2qfy-0nu-8AGJAV1mFuI Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Domain-Id: None Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Domain-Name: None Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Identity-Status: Confirmed Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Is-Admin-Project: True Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Domain-Id: default Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Domain-Name: Default Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Project-Name: admin Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Role: admin,reader,member Aug 09 19:07:30.830152 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Roles: admin,reader,member Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/de422168330743c9990b96b3dab6b6f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_de422168330743c9990b96b3dab6b6f7"}]}] Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Tenant: admin Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Tenant-Id: de422168330743c9990b96b3dab6b6f7 Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-Tenant-Name: admin Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User: admin Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Domain-Id: default Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Domain-Name: Default Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Id: 910b0103ce4a49babfe0b9390ae4fdd2 Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: X-User-Name: admin Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: method: > Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: exception: Flavor 451 could not be found. Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: action_args: {'id': '451'} Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:07:30.832523 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:30.833780 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: ERROR nova.api.openstack.wsgi Aug 09 19:07:30.835311 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-1ba1fe29-4234-4159-85ff-b4a1b19930e7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103312) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:07:30.836655 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-1ba1fe29-4234-4159-85ff-b4a1b19930e7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011688 Aug 09 19:07:30.836655 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 26/52] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Aug 9 19:07:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 19:07:31.810475 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:31.811524 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 09 19:07:31.811924 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 27/53] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:07:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:32.343461 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-bd4ce3cb-02e6-4639-9ef4-4389526a29f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:07:32.364028 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-bd4ce3cb-02e6-4639-9ef4-4389526a29f9 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.412951 Aug 09 19:07:32.364890 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 27/54] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Aug 9 19:07:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:07:33.342601 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:33.343621 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Aug 09 19:07:33.344051 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 28/55] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:07:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:33.883678 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-c8d55590-39f4-4546-90a9-eb4ca80b87ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:07:33.902446 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-c8d55590-39f4-4546-90a9-eb4ca80b87ba admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.419808 Aug 09 19:07:33.902999 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 28/56] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Aug 9 19:07:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 19:07:34.903901 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:34.904986 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 09 19:07:34.905394 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 29/57] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:07:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:35.433806 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-9cc740d8-35fc-4981-9e12-1b87aa0eb70d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:07:35.452525 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-9cc740d8-35fc-4981-9e12-1b87aa0eb70d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.401264 Aug 09 19:07:35.453063 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 29/58] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Aug 9 19:07:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:07:36.446961 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:36.447964 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 09 19:07:36.448360 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 30/59] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:07:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:36.973339 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-70975e8f-dba1-46b9-b202-58c9f949b2ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:07:36.991982 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-70975e8f-dba1-46b9-b202-58c9f949b2ff admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407869 Aug 09 19:07:36.992479 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 30/60] 10.222.0.70 () {64 vars in 1235 bytes} [Tue Aug 9 19:07:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:07:37.975810 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:37.976850 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 09 19:07:37.977280 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 31/61] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:07:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:07:38.622522 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-c0d81fa4-90ec-4d53-b53e-1b5e4707c9c5 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:07:38.642766 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-c0d81fa4-90ec-4d53-b53e-1b5e4707c9c5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.527156 Aug 09 19:07:38.643230 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 31/62] 10.222.0.70 () {60 vars in 1202 bytes} [Tue Aug 9 19:07:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:08:30.651196 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:08:30.652190 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-eefdf2d5-67fe-4321-b8e2-e803b9995ccb admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 09 19:08:30.652622 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 32/63] 10.222.0.70 () {54 vars in 931 bytes} [Tue Aug 9 19:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:08:30.663235 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:08:31.048161 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-55adaf05-8f2a-493c-b7e9-7e44ca0ad81c admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:08:31.069784 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-55adaf05-8f2a-493c-b7e9-7e44ca0ad81c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411248 Aug 09 19:08:31.070321 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 32/64] 10.222.0.70 () {60 vars in 1292 bytes} [Tue Aug 9 19:08:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:08:31.090828 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG dbcounter [-] [103311] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:08:31.095031 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-8b9e85ec-50c7-4d30-9246-1054c76cb6c5 admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:08:31.104123 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-8b9e85ec-50c7-4d30-9246-1054c76cb6c5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014703 Aug 09 19:08:31.104677 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 33/65] 10.222.0.70 () {60 vars in 1283 bytes} [Tue Aug 9 19:08:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:08:31.116777 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-27984323-1e0a-488b-8f67-d56ad430bb32 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:08:31.124507 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-27984323-1e0a-488b-8f67-d56ad430bb32 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011274 Aug 09 19:08:31.125034 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 33/66] 10.222.0.70 () {60 vars in 1286 bytes} [Tue Aug 9 19:08:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:08:31.136293 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:08:31.145160 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012359 Aug 09 19:08:31.145682 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 34/67] 10.222.0.70 () {60 vars in 1286 bytes} [Tue Aug 9 19:08:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:08:31.157108 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-939138b7-966a-4ea0-837f-689711749287 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:08:31.165568 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-939138b7-966a-4ea0-837f-689711749287 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012031 Aug 09 19:08:31.166089 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 34/68] 10.222.0.70 () {60 vars in 1283 bytes} [Tue Aug 9 19:08:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:11:47.366169 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:11:47.367183 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 09 19:11:47.367577 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 35/69] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:11:47.512734 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_api:SELECT=6 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:11:47.671336 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-f1bacb31-2a74-4e2a-8080-352478c8fd46 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:11:47.673761 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:11:47.673761 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: warnings.warn(msg) Aug 09 19:11:47.674874 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-f1bacb31-2a74-4e2a-8080-352478c8fd46 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:11:47.675354 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-f1bacb31-2a74-4e2a-8080-352478c8fd46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:11:47.675782 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-f1bacb31-2a74-4e2a-8080-352478c8fd46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:11:47.676517 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-f1bacb31-2a74-4e2a-8080-352478c8fd46 admin admin] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:11:47.677232 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-f1bacb31-2a74-4e2a-8080-352478c8fd46 admin admin] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:11:47.677649 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-f1bacb31-2a74-4e2a-8080-352478c8fd46 admin admin] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:11:47.712151 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-f1bacb31-2a74-4e2a-8080-352478c8fd46 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205620 Aug 09 19:11:47.712741 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 35/70] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Aug 9 19:11:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:11:48.544031 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:11:48.545065 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 09 19:11:48.545467 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 36/71] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:11:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:11:48.737072 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-51bb6e74-2ba8-4387-9a5f-0a36b6b8bb07 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:11:48.739470 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:11:48.739470 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: warnings.warn(msg) Aug 09 19:11:48.740644 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-51bb6e74-2ba8-4387-9a5f-0a36b6b8bb07 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:11:48.741111 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-51bb6e74-2ba8-4387-9a5f-0a36b6b8bb07 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:11:48.741531 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-51bb6e74-2ba8-4387-9a5f-0a36b6b8bb07 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:11:48.742230 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-51bb6e74-2ba8-4387-9a5f-0a36b6b8bb07 admin admin] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:11:48.742704 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-51bb6e74-2ba8-4387-9a5f-0a36b6b8bb07 admin admin] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:11:48.743133 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-51bb6e74-2ba8-4387-9a5f-0a36b6b8bb07 admin admin] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:11:48.762834 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-51bb6e74-2ba8-4387-9a5f-0a36b6b8bb07 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078241 Aug 09 19:11:48.763380 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 36/72] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Aug 9 19:11:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:12:00.013726 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:12:00.014738 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Aug 09 19:12:00.015141 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 37/73] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:12:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:12:00.163153 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_cell0:SELECT=4 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:00.163872 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_cell1:SELECT=4 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:00.164615 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG dbcounter [-] [103312] Writing DB stats nova_api:SELECT=8 {{(pid=103312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:12:00.213359 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-8cc4e52d-d92b-4372-8d5b-d28fa5731f0a admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:12:00.215733 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:12:00.215733 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: warnings.warn(msg) Aug 09 19:12:00.216921 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-8cc4e52d-d92b-4372-8d5b-d28fa5731f0a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:12:00.217420 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-8cc4e52d-d92b-4372-8d5b-d28fa5731f0a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:12:00.217875 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-8cc4e52d-d92b-4372-8d5b-d28fa5731f0a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:12:00.218616 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-8cc4e52d-d92b-4372-8d5b-d28fa5731f0a admin admin] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:12:00.219059 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-8cc4e52d-d92b-4372-8d5b-d28fa5731f0a admin admin] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:12:00.219482 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-8cc4e52d-d92b-4372-8d5b-d28fa5731f0a admin admin] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:12:00.244422 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-8cc4e52d-d92b-4372-8d5b-d28fa5731f0a admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085650 Aug 09 19:12:00.245559 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 37/74] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Aug 9 19:12:00 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:12:01.068420 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: DEBUG nova.api.openstack.wsgi [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] Calling method '>' {{(pid=103311) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:12:01.069439 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: INFO nova.api.openstack.requestlog [None req-1afbfaed-1217-4f5a-b548-4b24f209817d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 09 19:12:01.069857 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: [pid: 103311|app: 0|req: 38/75] 10.222.0.70 () {56 vars in 1074 bytes} [Tue Aug 9 19:12:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:12:01.266391 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG nova.api.openstack.wsgi [None req-765e40e5-f8e4-45da-b739-3f39c4a46644 admin admin] Calling method '>' {{(pid=103312) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:12:01.268801 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 19:12:01.268801 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: warnings.warn(msg) Aug 09 19:12:01.269905 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-765e40e5-f8e4-45da-b739-3f39c4a46644 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:12:01.270380 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-765e40e5-f8e4-45da-b739-3f39c4a46644 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:12:01.270812 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-765e40e5-f8e4-45da-b739-3f39c4a46644 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:12:01.271529 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-765e40e5-f8e4-45da-b739-3f39c4a46644 admin admin] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:12:01.271979 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-765e40e5-f8e4-45da-b739-3f39c4a46644 admin admin] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:12:01.272398 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: DEBUG oslo_concurrency.lockutils [None req-765e40e5-f8e4-45da-b739-3f39c4a46644 admin admin] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103312) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:12:01.294997 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: INFO nova.api.openstack.requestlog [None req-765e40e5-f8e4-45da-b739-3f39c4a46644 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085664 Aug 09 19:12:01.295486 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: [pid: 103312|app: 0|req: 38/76] 10.222.0.70 () {60 vars in 1193 bytes} [Tue Aug 9 19:12:01 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:13:02.279739 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: Tue Aug 9 19:13:02 2022 - graceful shutdown triggered... Aug 09 19:13:02.279631 dv-cinder-852654-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 19:13:02.281106 dv-cinder-852654-1-iscsi devstack@n-api.service[103311]: Gracefully killing worker 1 (pid: 103311)... Aug 09 19:13:02.281528 dv-cinder-852654-1-iscsi devstack@n-api.service[103312]: Gracefully killing worker 2 (pid: 103312)... Aug 09 19:13:03.280652 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: worker 1 buried after 1 seconds Aug 09 19:13:03.281402 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: worker 2 buried after 1 seconds Aug 09 19:13:03.281402 dv-cinder-852654-1-iscsi devstack@n-api.service[103310]: goodbye to uWSGI. Aug 09 19:13:03.282584 dv-cinder-852654-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 19:13:03.283200 dv-cinder-852654-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 19:13:03.286173 dv-cinder-852654-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 19:13:03.295341 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 19:13:03.298081 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 19:13:03 2022] *** Aug 09 19:13:03.298255 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 19:13:03.298387 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 19:13:03.298499 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: nodename: dv-cinder-852654-1-iscsi Aug 09 19:13:03.298609 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: machine: x86_64 Aug 09 19:13:03.298725 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: clock source: unix Aug 09 19:13:03.298838 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: pcre jit disabled Aug 09 19:13:03.298944 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: detected number of CPU cores: 4 Aug 09 19:13:03.299050 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: current working directory: / Aug 09 19:13:03.299159 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: detected binary path: /usr/bin/uwsgi-core Aug 09 19:13:03.299283 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: your processes number limit is 47680 Aug 09 19:13:03.299393 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: your memory page size is 4096 bytes Aug 09 19:13:03.299500 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: detected max file descriptor number: 2048 Aug 09 19:13:03.299615 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: lock engine: pthread robust mutexes Aug 09 19:13:03.299900 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: thunder lock: enabled Aug 09 19:13:03.300118 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 19:13:03.300248 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 19:13:03.349508 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: Python main interpreter initialized at 0x5582bde799c0 Aug 09 19:13:03.349508 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: python threads support enabled Aug 09 19:13:03.349508 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: your server socket listen backlog is limited to 100 connections Aug 09 19:13:03.349508 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: your mercy for graceful operations on workers is 90 seconds Aug 09 19:13:03.349963 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 19:13:03.349963 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: *** Operational MODE: preforking *** Aug 09 19:13:03.350300 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: *** uWSGI is running in multiple interpreter mode *** Aug 09 19:13:03.350300 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: spawned uWSGI master process (pid: 117802) Aug 09 19:13:03.350528 dv-cinder-852654-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 19:13:03.351988 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: spawned uWSGI worker 1 (pid: 117822, cores: 1) Aug 09 19:13:03.352594 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: spawned uWSGI worker 2 (pid: 117823, cores: 1) Aug 09 19:13:03.352871 dv-cinder-852654-1-iscsi devstack@n-api.service[117802]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 19:13:04.019927 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 19:13:04.036912 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 19:13:05.184193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 19:13:05.184193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: from cryptography.utils import int_from_bytes Aug 09 19:13:05.184864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 19:13:05.184864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: from cryptography.utils import int_from_bytes Aug 09 19:13:05.201158 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 19:13:05.201158 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: from cryptography.utils import int_from_bytes Aug 09 19:13:05.201709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 19:13:05.201709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: from cryptography.utils import int_from_bytes Aug 09 19:13:07.513716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 19:13:07.514236 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 19:13:07.514521 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 19:13:07.514872 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 19:13:07.515130 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 19:13:07.515520 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.515853 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.516174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.516530 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.516863 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.517176 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.517500 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.517822 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.518153 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.518416 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.518732 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.519058 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852654-1-iscsi {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.519380 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.519690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.520012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.520325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.520667 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.521157 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.521308 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.521429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 19:13:07.521812 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 19:13:07.521922 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.522091 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 19:13:07.522468 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 19:13:07.522686 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.523250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 19:13:07.523341 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.523420 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.523512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.523824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.523920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.524047 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.525040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.525692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.526132 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.526132 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.526894 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.526894 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.527066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.527147 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.527246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.527246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.527246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852654-1-iscsi {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.527246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.527841 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.527841 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.527978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.528047 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.528257 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.528501 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.528675 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.528830 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.528972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.529284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.529426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.529604 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.529723 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852654-1-iscsi {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.529943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.530116 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.530269 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.530577 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.530903 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.531207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.531383 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.531517 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.531737 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.531830 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.532083 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.532173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.532410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.532576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.532762 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.532864 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.533017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.533117 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.533327 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.533599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.533721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.533922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.534013 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.534239 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.534338 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.534512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.534655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.534791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.534922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.535057 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.535183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.535381 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.535485 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.535692 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.535803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.536002 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.536101 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.536310 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.536431 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.536644 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.536775 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.536954 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.537181 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852654-1-iscsi {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.537278 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.537501 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.537599 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.537818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.537921 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.538135 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.538234 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.538460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.538560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.538784 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.538883 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.539095 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.539194 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.539423 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.539554 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.539822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.539944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.540071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.540188 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.540382 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.540584 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.540836 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.540998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.541199 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.541362 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.541497 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.541632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.541816 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.541911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.542127 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.542218 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.542438 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.542538 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.542748 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.542839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.543052 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.543231 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.543380 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.543623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.543822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.543971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.544133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.544341 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.544522 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.544681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.544681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.544952 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.545100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.545250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.545250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.545543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.545686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.545829 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.545976 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.546126 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.546282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.546434 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.546582 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.546745 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.546899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.547047 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.547203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.547353 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.547506 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.547658 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.547807 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.547948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.548097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.548245 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.549837 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.549956 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.550064 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.550151 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.550248 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.550338 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.550484 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.550580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.550670 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.550759 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.551121 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.551217 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.551300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.551388 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.551388 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.551604 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.551700 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.551785 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.551923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552102 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552190 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552273 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552353 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552654 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552724 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552875 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.552954 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.553032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.553104 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.553171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.553319 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.553475 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.553786 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.553971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.554080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.554253 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.554346 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.554437 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.554577 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.554678 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.554830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.554986 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.555134 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.555295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.555443 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.555606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.555764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.555918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.556072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.556251 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.556586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.556729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.556915 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.557156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.557327 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.557458 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.557736 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.557836 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.558044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.558136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.558364 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.558459 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.558675 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.558766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.558985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.559086 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.559295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.559395 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.559601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.559697 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.559918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.560050 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.560227 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.560339 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.560574 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.560689 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.560897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.560992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.561205 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.561312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.561514 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.561614 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.561823 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.561943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.562132 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.562242 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.562454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.562553 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.562763 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.562855 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.563071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.563161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.563395 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.563500 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.563705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.563794 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.564012 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.564110 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.564354 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.564531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.564667 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.564806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.564953 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.565099 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.565275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.565439 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.565577 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.565719 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.565875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.566015 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.566193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.566347 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.566485 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.566629 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.566796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.566945 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.567090 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.567235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.567383 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.567527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.567691 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.567838 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.567988 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.568125 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.568290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.568546 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.568654 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.568747 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.568896 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.569048 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.569216 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.569364 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.569540 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.569685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.569840 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.570074 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.570191 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.570326 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.570472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.570658 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.570769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 19:13:07.570972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.571110 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.571293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.571610 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.572534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.572789 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.572916 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.573153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.573268 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.573469 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.573568 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.573806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.573906 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.574124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.574230 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.574462 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.574563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.574758 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.574865 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.575078 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.575184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.575395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.575523 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.575705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.575826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.576021 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.576143 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.576329 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.576562 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.576685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.576818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.576943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.577111 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.577239 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.577444 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.577564 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.577764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.577884 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.578084 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.578201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.578405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.578525 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.578721 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.578840 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.579040 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.579159 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.579371 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.579490 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.579686 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.579803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.579996 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.580145 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.580353 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.580505 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.580630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.580793 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.580941 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.581069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.581251 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.581378 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.581578 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.581704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.581892 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.582019 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.582201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.582319 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.582533 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.582677 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.582878 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.583007 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.583119 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.583228 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.583436 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.583610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.583765 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.583918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.584060 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.584203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.584351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.584551 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.584707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.584851 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.584992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.585134 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.585300 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.585457 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.585617 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.585768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.585940 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.586089 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.586238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.586397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.586553 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.586703 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.586853 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.586995 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.587144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.587295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.587511 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.588233 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.588596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.588781 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.588936 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.589090 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.589246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.589389 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.589539 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.589681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.589831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.589982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.590125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.590267 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.590500 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.590649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.590841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.590998 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.591160 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.591315 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.591315 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.591584 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.591731 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.591885 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.592034 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.592183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.592339 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.592509 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.592774 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.593021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.593169 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.593311 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.593471 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.593624 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.593624 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.593907 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.594048 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.594196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.594338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.594478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.594627 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.594770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.594918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.595059 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.595200 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.595357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.595507 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.595656 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.595806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.595947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.596096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.596251 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.596392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.596567 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.596711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.596957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.597107 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.597329 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.597481 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.597638 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.597782 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.597925 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.598076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.598231 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.598374 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.598523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.598674 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.598824 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.598966 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.599120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.599279 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.599421 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.599562 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.599702 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.599857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.600000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.600147 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.600296 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.600501 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.600715 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.600917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.601066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.601213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.601372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.601515 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.601664 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.601818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.601959 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.602101 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.602242 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.602383 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.602530 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.602680 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.602869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.603289 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.603450 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.603613 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.603774 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.603926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.603926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.604203 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.604346 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.604517 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.604680 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.604823 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.604970 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.605112 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.605260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.605401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.605566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.605715 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.605857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.605996 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.606144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.606287 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.606440 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.606593 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.606735 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.606883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.607038 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.607193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.607354 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.607497 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.607651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.607793 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.607948 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.608107 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.608251 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.608401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.608563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.608716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.608865 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.609014 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.609164 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.609325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.609468 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.609608 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.609748 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.609897 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.610038 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.610178 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.610319 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.610461 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.610609 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.610844 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.611035 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.611185 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.611337 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.611479 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.611635 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.611777 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.611934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.612083 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.612225 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.612366 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.612542 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.612696 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.612838 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.612986 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.613153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.613466 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.613633 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.613777 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.613918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.614067 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.614217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.614366 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.614522 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.614817 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.614992 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.615158 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.615310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.615460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.615628 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.615770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.615917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.616065 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.616214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.616369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.616589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.616734 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.616884 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.617033 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.617175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.617330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.617488 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.617631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.617774 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.618047 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.618218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.618376 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.618518 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.618710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.618893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.619071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.619225 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.619375 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.619517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.619677 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.619828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.619978 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.620134 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.620283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.620424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.620654 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.620815 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.621096 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.621260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.621404 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.621553 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.621701 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.621865 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.622007 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.622158 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.622299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.622447 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.622589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.622736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.622886 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.623037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.623178 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.623320 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.624638 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.624813 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.624813 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.625128 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.625468 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.625613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.625761 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.625903 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.626058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.626203 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.626353 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.626493 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.626635 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.626774 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.626941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.626941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.627211 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.627366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.627526 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.627727 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.627881 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.628024 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.628178 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.628332 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.628503 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.628660 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.628809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.628963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.629113 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.629266 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.629408 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.629550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.629697 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.629840 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.629999 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.630148 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.630297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.630439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.630580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.630753 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.630923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.631243 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.631394 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.631537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.631678 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.631827 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.631978 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.632129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.632271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.632414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.632591 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.632736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.632955 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.633110 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.633252 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.633394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.633536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.633792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.633948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.634092 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.634945 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.634945 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.635303 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.635502 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.635829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.635829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.636312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.636427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.636888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.637049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.637192 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.637333 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.637473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.637473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.637794 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.637952 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.638103 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.638255 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.638425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.638579 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.638731 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.638935 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.639092 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.639251 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.639394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.639583 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.639583 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.639875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.639875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.640143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.640284 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.640466 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.640747 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.640897 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.641079 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.641363 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.641594 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.641758 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.641912 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.642055 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.642203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.642393 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.642552 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.642873 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.643103 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.643368 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.643517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.643681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.643845 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.644173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.644332 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.644555 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.644706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.644896 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.645173 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.645325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.645494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.645638 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.645789 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.645932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.646075 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.646227 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.646421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.646574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.646726 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.646909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.647066 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.647209 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.647358 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.647510 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.647662 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.647813 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.647955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.648097 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.648247 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.648412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.648599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.648758 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.648951 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.649112 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.649270 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.649430 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.649590 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.649738 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.649956 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.650696 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.651002 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.651196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.651501 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.651665 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.651810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.651952 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.652102 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.652258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.652413 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.652590 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.652741 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.652884 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.653105 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.653260 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.653418 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.653560 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.653707 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.653849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.653999 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.654385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.654540 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.654694 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.654844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.654993 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.655194 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.655438 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.655588 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.655739 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.655882 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.656030 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.656186 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.656337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.656526 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.656677 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.656829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.656829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.657152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.657302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.657451 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.657603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.657745 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.657745 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.658036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.658178 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.658334 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.658334 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.658616 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.658777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.658920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.659062 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.667481 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.667714 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.667891 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.668061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.668221 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.668382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.668688 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.668837 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.668981 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.669139 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.669296 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.669439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.669580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.669722 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.669874 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.670033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.670184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.670340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.670489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.670644 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.670802 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.670958 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.671115 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.671276 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.671475 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.671657 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.671816 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.671966 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.672124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.672283 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.672432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.672616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.672775 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.672932 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.673081 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.673444 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.673604 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.673767 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.675499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.675687 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.676116 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.676285 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.676498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.676671 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.676833 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.676985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.677141 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.677299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.677461 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.677664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.677817 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.677966 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.678113 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.678273 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.678428 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.678596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.678787 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.678945 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.679100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.679259 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.679417 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.679619 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.679773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.679922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.680077 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.680227 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.680389 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.680573 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.680772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.680927 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.681083 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.681339 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.681569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.681776 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.681949 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.682286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.682442 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.682590 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.682873 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.683036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.683186 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.683358 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.683630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.683803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.683962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.684120 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.684289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.684464 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.684631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.684793 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.684987 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.685141 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.685288 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.685443 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.685590 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.685752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.685903 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.686058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.686213 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.686379 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.686379 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.686679 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.686830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.687020 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.687175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.687330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.687480 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.687683 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.687845 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.687996 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.688144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.688303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.688519 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.688677 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.688833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.688983 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.689139 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.689288 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.689449 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.689598 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.689968 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.690128 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.690278 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.690426 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.690584 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.690751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.690900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.691092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.691248 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.691398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.691557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.691706 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.691862 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.692011 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.692162 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.692324 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.692491 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.692666 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.692816 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.692963 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.693118 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.693277 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.693425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.693425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.693859 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.694022 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.694171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.694331 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.694487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.694487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.694487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.694487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.694487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.694487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.695372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.695521 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.695708 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.695862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.696024 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.696173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.696173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.696173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.696173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.696173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.696173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.696173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.697969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.698119 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.698322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.698473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.698473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.698773 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.698929 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699445 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699604 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699753 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.699901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.700788 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.700937 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.701098 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.701255 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.701414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.701563 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.701711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.701869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.702018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.702166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.702314 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.702461 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.702609 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.702767 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.702925 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.703074 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.703352 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.703530 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.703530 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.704008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.704165 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.704322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.704602 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.704764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.704914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.704914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.705213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.705374 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.705524 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.705680 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.705924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.706076 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.706225 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.706374 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.706529 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.706678 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.706837 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.706995 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.707144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.707292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.707448 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.707598 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.707773 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.707923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.708071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.708226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.708383 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.708557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.708557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.708880 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.709043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.709201 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.709359 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.709519 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.709675 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.709844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.710002 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.710152 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.710307 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.710465 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.710621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.710781 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.710931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.711081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.711229 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.711421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.711586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.711736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.711898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.712047 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.712196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.712373 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.713151 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.713338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.713501 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.713652 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.713854 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.713854 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.714235 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.714398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.714566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.714722 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.714885 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.715033 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.715180 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.715337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.715337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.715627 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.715788 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.715938 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.716085 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.716232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.716380 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.716576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.716735 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.716944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.717104 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.717254 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.717408 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.717566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.717722 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.717878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.720329 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.720461 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.720555 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.720647 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.720721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.720799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.720877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.720962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721033 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721112 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721112 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721239 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721309 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721377 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721460 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721700 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721778 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721847 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.721930 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722001 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722155 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722301 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722534 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722610 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722758 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722840 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.722981 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723049 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723208 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723280 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723502 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.723913 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724006 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724084 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724332 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724510 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724592 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724663 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724731 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724866 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.724934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725015 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725094 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725164 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725310 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725457 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725528 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725604 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725675 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725743 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725825 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725902 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.725973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726049 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726049 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726174 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726255 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726332 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726482 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726553 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726628 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726913 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.726913 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727121 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727199 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727549 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.727925 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728139 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728349 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728349 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728633 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728718 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728865 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.728943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729364 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729364 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729498 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729588 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729789 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729866 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729936 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.729936 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730138 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730296 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730368 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730448 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730519 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730660 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730736 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730814 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.730951 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731018 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731093 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731169 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731316 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731316 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731446 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731763 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731832 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731832 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.731974 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732269 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732500 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732711 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732786 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732857 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.732938 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733015 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733085 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733155 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733155 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733360 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733504 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733581 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733657 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733812 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.733888 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734084 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734323 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734468 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734535 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734602 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734755 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734891 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.734967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735057 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735135 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735204 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735280 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735349 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735416 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735492 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735637 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735779 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735849 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.735925 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.736002 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.736071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.736228 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.738657 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.738851 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.738851 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.739151 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.739151 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.739458 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.739609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.739766 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.739923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.740073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.740230 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.740380 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.740614 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.740780 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.740931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.740931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.741212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.741366 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.741525 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.741687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.741844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.741992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.742150 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.742298 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.742460 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.742619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.742767 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.742767 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.743055 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.743203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.743363 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.743694 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.743895 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.744128 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.744292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.744292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.744636 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.744788 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.744937 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.745092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.745249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.745412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.745561 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.745710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.745857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.746004 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.746153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.746329 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.746486 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.746642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.747464 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.751369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.751541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.751711 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.751867 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.752020 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.752171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.752383 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.752559 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.752728 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.752901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.753063 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.753221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.753378 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.753541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.753691 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.753846 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.753993 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.753993 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.754347 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.754506 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.754663 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.754663 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.754963 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.754963 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.755244 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.755401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.755401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.755698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.755855 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.756010 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.756167 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.756316 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.756488 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.756660 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.756821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.756821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.757186 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.757348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.757551 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.757551 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.757846 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.758003 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.758159 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.758324 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.758472 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.758657 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.758807 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.758966 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.759124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.759884 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.760137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.760345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.760606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.760792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.760995 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.761157 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.761306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.761463 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.761621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.761796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.761954 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.762103 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.762250 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.762399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.762554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.762717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.762866 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.763021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.763177 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.763333 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.763484 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.763642 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.763809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.763960 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.764107 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.764107 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.764493 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.764650 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.764800 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.764947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.764947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.765250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.765414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.765565 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.765712 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.765871 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.766027 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.766183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.766350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.766350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.766650 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.766806 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.766954 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.767100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.767256 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.767405 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.767552 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.767700 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.767859 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.768016 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.768173 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.768371 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.768545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.768545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.768841 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.768998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.769147 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.769296 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.769443 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.769590 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.769756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.769918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.770066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.770221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.770376 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.770532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.770773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.770931 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.771079 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.771236 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.771384 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.771541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.771700 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.771861 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.772017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.772166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.772320 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.772496 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.772664 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.772822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.772979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.773128 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.773281 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.773434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.773591 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.773757 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.773905 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.774054 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.774210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.774407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.774570 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.774729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.774935 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.775599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.775758 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.775918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.776132 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.776290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.776473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.776473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.776784 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.776944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.777095 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.777251 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.777401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.777557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.777557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.777856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.778005 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.778163 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.778330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.778480 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.778638 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.778795 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.778953 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.779102 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.779259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.779416 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.779574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.779724 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.779872 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.780028 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.780188 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.780188 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.780550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.780718 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.780991 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.781145 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.781297 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.781460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.781611 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.781767 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.781917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.782064 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.782221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.782397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.782397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.782700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.782849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783163 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783321 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783474 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117823) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 19:13:07.783632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.783632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.784857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.784857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.784857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.784857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.784857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.784857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.784857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.784857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.785985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.785985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.785985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.785985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.785985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.785985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.785985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.785985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.787125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.787125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.787125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.787125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.787125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.787125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.787125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.787125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.788944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.788944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.788944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.788944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.788944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.788944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.788944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.788944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.790098 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.790098 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.790404 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.790605 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.791149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.791433 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.791776 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.792104 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.792422 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.792789 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.793109 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.793426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.793741 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.794056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.794372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.794760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.795115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.795322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.795644 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.795967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.796305 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.796667 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.796986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.797317 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.797679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.798034 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.798351 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.798704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.799036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.799356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.799921 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.800090 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 19:13:07.800240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117822) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 19:13:07.929490 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO dbcounter [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Registered counter for database nova_api Aug 09 19:13:07.950164 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_db.sqlalchemy.engines [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:13:07.953076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO dbcounter [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Registered counter for database nova_api Aug 09 19:13:07.957124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writer thread running {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:13:07.973133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_db.sqlalchemy.engines [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:13:07.980754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writer thread running {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:13:08.015434 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.context [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00066696-20f3-4c56-9a74-e60e6ce0ffd8(cell1) {{(pid=117823) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 19:13:08.019504 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:13:08.019976 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:13:08.021580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:13:08.022319 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:13:08.022764 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:13:08.024787 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:13:08.026808 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO dbcounter [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Registered counter for database nova_cell0 Aug 09 19:13:08.030868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO dbcounter [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Registered counter for database nova_cell1 Aug 09 19:13:08.038674 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_db.sqlalchemy.engines [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:13:08.039169 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.context [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),00066696-20f3-4c56-9a74-e60e6ce0ffd8(cell1) {{(pid=117822) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 19:13:08.040604 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_db.sqlalchemy.engines [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:13:08.043631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:13:08.044107 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:13:08.045718 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:13:08.046453 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:13:08.046897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:13:08.047798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writer thread running {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:13:08.048149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writer thread running {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:13:08.048930 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:13:08.051192 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO dbcounter [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Registered counter for database nova_cell0 Aug 09 19:13:08.055251 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO dbcounter [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Registered counter for database nova_cell1 Aug 09 19:13:08.064558 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_db.sqlalchemy.engines [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:13:08.065948 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_db.sqlalchemy.engines [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:13:08.073546 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writer thread running {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:13:08.074871 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writer thread running {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:13:08.197246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO dbcounter [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Registered counter for database nova_cell0 Aug 09 19:13:08.203791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_db.sqlalchemy.engines [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117823) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:13:08.208181 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writer thread running {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:13:08.222211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO dbcounter [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Registered counter for database nova_cell0 Aug 09 19:13:08.231117 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_db.sqlalchemy.engines [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117822) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 19:13:08.236044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writer thread running {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 19:13:08.528576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: WARNING keystonemiddleware.auth_token [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 19:13:08.535795 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: WARNING keystonemiddleware.auth_token [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 19:13:08.566257 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: WARNING keystonemiddleware.auth_token [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 19:13:08.574067 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: WARNING keystonemiddleware.auth_token [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 19:13:08.886745 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: WARNING keystonemiddleware.auth_token [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 19:13:08.892727 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: WARNING keystonemiddleware.auth_token [None req-3ca60b8a-e615-4813-8604-eadf402ae4a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 19:13:08.898984 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5582bde799c0 pid: 117823 (default app) Aug 09 19:13:08.931419 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: WARNING keystonemiddleware.auth_token [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 19:13:08.938739 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: WARNING keystonemiddleware.auth_token [None req-3b691c83-f1dc-43cb-bcc9-c8d1de133409 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 19:13:08.945123 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5582bde799c0 pid: 117822 (default app) Aug 09 19:13:48.068194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:13:48.069426 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:13:48.070084 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:13:48.070924 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:13:48.580804 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7191bcd7-adfb-49e6-ad59-f4d9e0470fb5 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa5098a5a60>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:13:50.541801 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7191bcd7-adfb-49e6-ad59-f4d9e0470fb5 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5a27b94f-6ced-46af-be1d-c27f492ba35d" status: 200 len: 350 microversion: 2.1 time: 2.481725 Aug 09 19:13:50.542422 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 1/1] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:13:48 2022] GET /compute/v2.1/os-volumes/5a27b94f-6ced-46af-be1d-c27f492ba35d => generated 350 bytes in 2484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:13:53.455674 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e200371b-8d7c-46ab-8a4b-86dcb7624164 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa50990d940>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:13:53.579490 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=3 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:13:53.582419 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=3 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:13:53.583058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=3 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:13:53.583798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=3 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:13:54.377071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e200371b-8d7c-46ab-8a4b-86dcb7624164 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/8d85afc9-af57-4eab-9593-572fba0ac0b6" status: 200 len: 351 microversion: 2.1 time: 1.581186 Aug 09 19:13:54.377668 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 1/2] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:13:52 2022] GET /compute/v2.1/os-volumes/8d85afc9-af57-4eab-9593-572fba0ac0b6 => generated 351 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:13:59.765508 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-44a3eea0-fae1-47d4-a006-efa6d1821460 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa50975ec10>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:13:59.942289 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-44a3eea0-fae1-47d4-a006-efa6d1821460 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/2ba659f3-062e-4a4d-83e7-9d1702e01b34" status: 200 len: 351 microversion: 2.1 time: 0.181363 Aug 09 19:13:59.943021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:13:59 2022] GET /compute/v2.1/os-volumes/2ba659f3-062e-4a4d-83e7-9d1702e01b34 => generated 351 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:13:59.971556 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6859af8e-f407-4a68-8c32-b89dc756d954 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa50975eca0>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:00.207480 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6859af8e-f407-4a68-8c32-b89dc756d954 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.245925 Aug 09 19:14:00.208223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 3/4] 10.222.0.70 () {58 vars in 1134 bytes} [Tue Aug 9 19:13:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:00.222844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d10064ba-0565-40eb-97fe-b7d1dc56de27 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa50975eaf0>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:00.478513 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d10064ba-0565-40eb-97fe-b7d1dc56de27 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.259402 Aug 09 19:14:00.487550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 4/5] 10.222.0.70 () {58 vars in 1149 bytes} [Tue Aug 9 19:14:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:14:00.493729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-12dcf44d-8911-430f-b759-1be3c85474b1 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa509722ee0>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:00.512462 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1393f7ce-fbaf-447e-b1cd-046a87f433e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'create', calling method: .version_select at 0x7fa5096ebb80>, body: {"keypair": {"name": "tempest-keypair-182124585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmNVh/KKktWuiD8jWr9uyQ7JafQylmIpsb3BJ+VZzByrds+rMBGSAkhf/y/zgQOjbWzwWEmQE6W2RfijKKLq/eU3Bxa/34SzvjgvORiXJPcyjaVMKLUrKlEnV2lBG7BAA=="}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:00.635849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-1393f7ce-fbaf-447e-b1cd-046a87f433e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Getting quotas for project 8b32d5c45c614fd08a57af6be1143590. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:14:00.651554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-1393f7ce-fbaf-447e-b1cd-046a87f433e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Getting quotas for user e9ad80a549b14b25ac71cd96832a74e7 and project 8b32d5c45c614fd08a57af6be1143590. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:14:00.762867 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1393f7ce-fbaf-447e-b1cd-046a87f433e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.063013 Aug 09 19:14:00.763799 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 2/6] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Aug 9 19:13:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1065 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 19:14:00.950680 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-12dcf44d-8911-430f-b759-1be3c85474b1 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.461356 Aug 09 19:14:00.952888 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 5/7] 10.222.0.70 () {58 vars in 1134 bytes} [Tue Aug 9 19:14:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:00.968030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1a7984bb-7c47-433d-ac2c-cd38f18200c1 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa5097221f0>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:01.267899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1a7984bb-7c47-433d-ac2c-cd38f18200c1 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.305795 Aug 09 19:14:01.277668 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 6/8] 10.222.0.70 () {58 vars in 1167 bytes} [Tue Aug 9 19:14:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:14:01.320648 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1751040264", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:01.430327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-212249137", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "networks": [{"uuid": "df2ef046-d792-47ad-8bf2-baed11477706"}]}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:01.503377 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] validate_networks() for [('84108d42-a333-4e3d-88e7-e08ac356df37', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:14:01.680848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] validate_networks() for [('df2ef046-d792-47ad-8bf2-baed11477706', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:14:03.078593 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:14:03.079793 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:14:03.080506 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:14:03.081113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:14:03.081936 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:14:03.102693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:03.104502 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:03.105180 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:03.106123 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:03.106818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:03.107770 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:03.147936 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Getting quotas for project df78df5c522b42b1b40aebf2502866e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:14:03.166960 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Getting quotas for user 5464533ccfb74094bf613bcd51c55ff1 and project df78df5c522b42b1b40aebf2502866e7. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:14:03.198560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:14:03.208073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:14:03.358531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3e84bbe2-189b-486a-afd2-3aee596f1ebe tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.088452 Aug 09 19:14:03.361578 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 7/9] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:14:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:14:03.375881 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-975f20ee-dfa4-45c2-9035-dbe1fc60c2b3 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa508dbf670>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:03.406029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:14:03.406576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:14:03.407274 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:14:03.407868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:14:03.408931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:14:03.428824 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:03.429348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:03.433986 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:03.435100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:03.438883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:03.440332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:03.502479 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Getting quotas for project 375ce88986dc47b08134e076562eee05. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:14:03.514451 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Getting quotas for user 8755b16a18734175b691f891351d5116 and project 375ce88986dc47b08134e076562eee05. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:14:03.537414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:14:03.541794 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:14:03.584220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-975f20ee-dfa4-45c2-9035-dbe1fc60c2b3 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.220770 Aug 09 19:14:03.585146 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 8/10] 10.222.0.70 () {58 vars in 1170 bytes} [Tue Aug 9 19:14:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:14:03.590448 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-13e12d4f-0e05-4fdb-9a10-6609b7dace82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:03.591246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-13e12d4f-0e05-4fdb-9a10-6609b7dace82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:03.726032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-27f61482-5980-4fb2-8e39-9381640df0fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.960934 Aug 09 19:14:03.734631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 3/11] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:14:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:14:03.740043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-bf122c14-01d8-4a01-9c27-0acbcf86c817 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa508de3ca0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:03.865033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-13e12d4f-0e05-4fdb-9a10-6609b7dace82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:03.897600 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-13e12d4f-0e05-4fdb-9a10-6609b7dace82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1214 microversion: 2.1 time: 0.309869 Aug 09 19:14:03.898269 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 9/12] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:03 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1214 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:03.916177 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1624acf3-4772-4f16-932f-79cae6f8bd30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:03.917312 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1624acf3-4772-4f16-932f-79cae6f8bd30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:04.069188 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-bf122c14-01d8-4a01-9c27-0acbcf86c817 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.331897 Aug 09 19:14:04.071245 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 4/13] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Aug 9 19:14:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:04.089203 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-97ae42dd-4f99-4218-b91d-287ecb4f8717 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa508d7fee0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:04.095773 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1624acf3-4772-4f16-932f-79cae6f8bd30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:04.108426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1624acf3-4772-4f16-932f-79cae6f8bd30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1222 microversion: 2.1 time: 0.208223 Aug 09 19:14:04.111308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 10/14] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:03 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:04.189933 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-532994181", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:04.316828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] validate_networks() for [('84108d42-a333-4e3d-88e7-e08ac356df37', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:14:04.559890 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-97ae42dd-4f99-4218-b91d-287ecb4f8717 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.475408 Aug 09 19:14:04.560988 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 5/15] 10.222.0.70 () {58 vars in 1188 bytes} [Tue Aug 9 19:14:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:14:04.610831 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-fe0eaa15-370d-454a-bc40-2c44fc5b9377 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] Calling method '.version_select at 0x7fa508d7fd30>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:04.985904 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-fe0eaa15-370d-454a-bc40-2c44fc5b9377 tempest-VolumesTestJSON-613589654 tempest-VolumesTestJSON-613589654-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.415350 Aug 09 19:14:04.986869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 6/16] 10.222.0.70 () {58 vars in 1155 bytes} [Tue Aug 9 19:14:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:04.992616 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3f440a8d-cd5c-4841-8312-75ddadc797a7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:04.993635 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3f440a8d-cd5c-4841-8312-75ddadc797a7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:05.235046 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3f440a8d-cd5c-4841-8312-75ddadc797a7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:05.261714 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3f440a8d-cd5c-4841-8312-75ddadc797a7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1214 microversion: 2.1 time: 0.273537 Aug 09 19:14:05.263026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 7/17] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:04 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1214 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:05.279388 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-110554337", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8832d330-8087-426c-a906-c4c5d0f4010e"}], "security_groups": [{"name": "tempest-securitygroup--421794660"}], "key_name": "tempest-keypair-182124585", "user_data": "}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:05.594043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] validate_networks() for [('8832d330-8087-426c-a906-c4c5d0f4010e', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:14:06.018942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:14:06.019464 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:14:06.020735 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:14:06.021213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:14:06.021694 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:14:06.038758 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:06.040175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:06.041156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:06.042191 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:06.042843 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:06.043673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:06.066000 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Getting quotas for project 375ce88986dc47b08134e076562eee05. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:14:06.070736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Getting quotas for user 8755b16a18734175b691f891351d5116 and project 375ce88986dc47b08134e076562eee05. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:14:06.084685 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:14:06.087827 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:14:06.148997 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8d55122e-60dc-415f-90d2-0695054ca2cb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.963196 Aug 09 19:14:06.150688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 11/18] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:14:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 19:14:06.165449 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b0908ae7-fe55-4874-bab0-9ebe0fc341a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:06.166369 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b0908ae7-fe55-4874-bab0-9ebe0fc341a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:06.252944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-b0908ae7-fe55-4874-bab0-9ebe0fc341a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:06.256996 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b0908ae7-fe55-4874-bab0-9ebe0fc341a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1221 microversion: 2.1 time: 0.099391 Aug 09 19:14:06.257626 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 12/19] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:06 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1221 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:06.293202 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:06.293833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:06.306815 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:06.310882 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:06.311457 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:06.312270 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:06.312774 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:06.313203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:06.619596 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:14:06.620811 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:14:06.621498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:14:06.622155 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:14:06.622774 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:14:06.639020 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:06.641990 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:06.642589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:06.643155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:06.643839 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:06.644415 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:06.645011 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:06.673778 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e984a6a7-38fe-46d2-abc0-4613376ff70a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1218 microversion: 2.1 time: 0.388670 Aug 09 19:14:06.675391 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 13/20] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:06 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1218 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:14:06.678089 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Getting quotas for project 8b32d5c45c614fd08a57af6be1143590. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:14:06.683896 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Getting quotas for user e9ad80a549b14b25ac71cd96832a74e7 and project 8b32d5c45c614fd08a57af6be1143590. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:14:06.725669 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:14:06.731634 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:14:06.849996 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c6b4e341-ce51-4fbf-9ba4-6615ed399f67 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.584056 Aug 09 19:14:06.857668 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 8/21] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Aug 9 19:14:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 19:14:06.865340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0bdc8954-2d51-4859-9a04-11707f34b0df tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:06.866199 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0bdc8954-2d51-4859-9a04-11707f34b0df tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:06.965227 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0bdc8954-2d51-4859-9a04-11707f34b0df tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:06.983156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0bdc8954-2d51-4859-9a04-11707f34b0df tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:06.987349 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0bdc8954-2d51-4859-9a04-11707f34b0df tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:06.995025 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0bdc8954-2d51-4859-9a04-11707f34b0df tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1280 microversion: 2.20 time: 0.135068 Aug 09 19:14:07.016899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 14/22] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:06 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1280 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:07.280765 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:07.281519 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:07.292912 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:07.296235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:07.298722 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:07.299618 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:07.300957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:07.302475 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:07.707362 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:07.708760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:07.730603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:07.732895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:07.737318 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:07.740301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:07.743348 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:07.745589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:07.749838 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:07.811629 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-076d34e5-e9bb-4f46-b289-60243298a691 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1225 microversion: 2.1 time: 0.530048 Aug 09 19:14:07.813993 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 9/23] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:07 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1225 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:08.023503 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-bd36b0e7-e88c-4f95-8c35-5103ff12025c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:08.024695 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-bd36b0e7-e88c-4f95-8c35-5103ff12025c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:08.234937 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bd36b0e7-e88c-4f95-8c35-5103ff12025c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:08.262051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bd36b0e7-e88c-4f95-8c35-5103ff12025c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:08.268425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bd36b0e7-e88c-4f95-8c35-5103ff12025c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:08.270168 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:08.271699 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-bd36b0e7-e88c-4f95-8c35-5103ff12025c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1280 microversion: 2.20 time: 0.254355 Aug 09 19:14:08.284698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8d1c2ff0-7829-488c-91f9-991a7afab90a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1266 microversion: 2.1 time: 0.589458 Aug 09 19:14:08.286040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 10/24] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:08 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:08.298049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 15/25] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:07 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1266 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:14:08.835219 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:08.836623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:08.857392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:08.862250 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:08.866053 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:08.869776 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:08.871287 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:08.874824 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:09.124074 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:09.137239 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d78817a1-f230-4208-9a45-e0260b4b53a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1281 microversion: 2.1 time: 0.306509 Aug 09 19:14:09.141152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 11/26] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:08 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1281 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:09.313049 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:09.313346 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:09.314618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:09.315409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:09.340308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:09.341521 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:09.342449 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:09.343935 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:09.344271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:09.344818 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:09.347632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:09.348082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:09.350566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:09.350993 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:09.351596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:09.362081 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:09.603893 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:09.626347 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f8de5f9a-3c97-486f-8cae-ce2f86cacebf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1274 microversion: 2.1 time: 0.321347 Aug 09 19:14:09.634863 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 12/27] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:09 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1274 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:09.981072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:10.018167 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:10.033580 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:10.039658 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e88fbe90-2909-48f6-823e-b1040be25671 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1332 microversion: 2.20 time: 0.741104 Aug 09 19:14:10.040286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 16/28] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:09 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1332 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:10.166505 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:10.167244 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:10.182515 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:10.185050 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:10.190402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:10.191344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:10.192923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:10.194362 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:10.656205 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:10.657693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:10.669219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:10.669888 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:10.672803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:10.673659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:10.674588 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:10.675814 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:10.914129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:10.931508 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-030fd784-5f65-4db0-8208-85537f8a98f1 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1272 microversion: 2.1 time: 0.277504 Aug 09 19:14:10.932934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 17/29] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:10 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:14:11.066876 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:11.067582 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:11.077051 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:11.085028 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:11.088197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:11.091451 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:11.094084 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:11.096513 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:11.433591 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:11.453585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:11.459439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:11.461829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0003dca8-78ef-40c5-84eb-d4416c32261c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1338 microversion: 2.20 time: 0.399693 Aug 09 19:14:11.479122 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 18/30] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:11 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1338 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:11.579605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:11.613575 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0e3d5986-66d2-4b8a-bf2c-a304002d6f08 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 1.451814 Aug 09 19:14:11.618797 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 13/31] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:10 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:11.955025 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:11.957353 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:11.980514 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:11.981510 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:11.986797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:12.001129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:12.004221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:12.007018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:12.502820 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:12.515525 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:12.539013 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:12.540093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:12.541064 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:12.541967 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:12.544920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:12.546211 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:12.613532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:12.625997 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8d3bd08a-d678-47b0-93d6-5bfacc39f684 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1272 microversion: 2.1 time: 0.674708 Aug 09 19:14:12.628934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 19/32] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:11 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1272 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:14:12.642916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:12.654162 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:12.684237 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:12.686203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:12.686673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:12.687435 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:12.693840 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:12.694613 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:12.889143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:12.915959 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:12.926494 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:12.928773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e7166a9d-2b57-4d68-9775-720d4b3e12af tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1338 microversion: 2.20 time: 0.432181 Aug 09 19:14:12.935753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 14/33] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:12 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1338 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:13.654315 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:13.655086 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:13.677071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:13.684923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:13.685556 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:13.691522 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:13.696010 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:13.708237 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:13.725811 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:13.751595 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e86b9161-2d1d-4139-96d9-636859002c93 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 1.098252 Aug 09 19:14:13.754768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 20/34] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:12 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:14:13.962723 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:13.963777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:13.986924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:13.988253 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:14.006651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:14.008205 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:14.013678 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:14.017571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:14.418516 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:14.434799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:14.436969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:14.440724 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bd59a575-e021-4a0f-a328-534a10cc42d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1338 microversion: 2.20 time: 0.485389 Aug 09 19:14:14.448207 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 21/35] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:13 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1338 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:14:14.769813 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:14.773922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:14.775194 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:14.783372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-919ea3a7-6d52-4748-b631-a799bc8f8871 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 1.136016 Aug 09 19:14:14.789686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:14.793473 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:14.793924 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 15/36] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:13 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:14.794543 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:14.795526 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:14.796219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:14.797585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:15.482892 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:15.483566 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:15.493177 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:15.496478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:15.497130 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:15.497928 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:15.501970 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:15.502479 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:15.892869 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:15.910427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bca01b1a-95c6-4419-a436-8a2fde8a0100 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 1.140000 Aug 09 19:14:15.923486 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 22/37] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:14 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:15.943405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:15.953226 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:15.976121 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:15.984547 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:15.985375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:15.986988 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:15.987830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:15.988370 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:16.069097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=4 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:16.449210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:16.459143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:16.470314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:16.471893 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e31cb559-6eb3-4e86-a5af-1964a127591e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.993639 Aug 09 19:14:16.477746 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 16/38] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:15 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:16.801736 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=4 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:16.976726 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=20 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:17.116077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:17.127798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-beddd5f8-b3f5-4f14-9a6c-64d172d7d7d6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 1.201456 Aug 09 19:14:17.128749 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 23/39] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:15 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:17.143779 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:17.144993 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:17.171828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:17.173092 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:17.175672 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:17.179763 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:17.192299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:17.193469 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:17.757168 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-87e43b3f-fe72-4821-b69b-020792b1720f req-5109a9d9-3b35-4c83-821a-d0d9e596db76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39198df8-0086-49fa-9144-f42684a5513a", "tag": "3b8e268c-bee6-4a6b-b29d-7f00e37ebbf0"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:17.791720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-87e43b3f-fe72-4821-b69b-020792b1720f req-5109a9d9-3b35-4c83-821a-d0d9e596db76 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:17.792753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-87e43b3f-fe72-4821-b69b-020792b1720f req-5109a9d9-3b35-4c83-821a-d0d9e596db76 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:17.794270 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-87e43b3f-fe72-4821-b69b-020792b1720f req-5109a9d9-3b35-4c83-821a-d0d9e596db76 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:17.850278 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-87e43b3f-fe72-4821-b69b-020792b1720f req-5109a9d9-3b35-4c83-821a-d0d9e596db76 service nova] Creating event network-changed:3b8e268c-bee6-4a6b-b29d-7f00e37ebbf0 for instance 39198df8-0086-49fa-9144-f42684a5513a on hv-cinder-85265 Aug 09 19:14:17.851101 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-87e43b3f-fe72-4821-b69b-020792b1720f req-5109a9d9-3b35-4c83-821a-d0d9e596db76 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117823) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 19:14:17.851792 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-87e43b3f-fe72-4821-b69b-020792b1720f req-5109a9d9-3b35-4c83-821a-d0d9e596db76 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117823) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 19:14:17.857656 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e0fa20b4-1e25-45a1-874b-53c8a4eca8ad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:17.858392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e0fa20b4-1e25-45a1-874b-53c8a4eca8ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:17.859064 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e0fa20b4-1e25-45a1-874b-53c8a4eca8ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:17.860094 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e0fa20b4-1e25-45a1-874b-53c8a4eca8ad None None] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:17.860824 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e0fa20b4-1e25-45a1-874b-53c8a4eca8ad None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:17.861585 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e0fa20b4-1e25-45a1-874b-53c8a4eca8ad None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:17.874243 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.compute.rpcapi [None req-e0fa20b4-1e25-45a1-874b-53c8a4eca8ad None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 19:14:17.875430 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e0fa20b4-1e25-45a1-874b-53c8a4eca8ad None None] Releasing lock "compute-rpcapi-router" {{(pid=117823) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 19:14:17.907883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e0fa20b4-1e25-45a1-874b-53c8a4eca8ad None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.112208 Aug 09 19:14:17.909383 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 17/40] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:14:17.917425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:17.921227 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:17.941606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:17.942683 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:17.944037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:17.951378 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:17.955378 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:17.956229 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:18.247303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=20 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:18.535569 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:18.550563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-198847ce-79a8-45ba-8481-ec74174c9305 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 1.417710 Aug 09 19:14:18.551752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 24/41] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:17 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:18.564139 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:18.565420 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:18.596690 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:18.598353 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:18.601604 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:18.602590 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:18.608202 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:18.609221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:18.856683 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:18.877845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:18.880216 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:18.884853 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-9a86c539-3820-48b4-a8eb-dc377e7ec3c4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.973704 Aug 09 19:14:18.891898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 18/42] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:17 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:19.436046 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:19.459444 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f293e065-5968-47cf-afe1-45bcb6027015 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.903437 Aug 09 19:14:19.461476 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 25/43] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:18 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:19.579607 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:19.580225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:19.589810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:19.590247 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:19.590697 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:19.591399 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:19.591855 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:19.592269 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:20.155315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fb613aa2-5fdb-4b99-b6ef-4b92eafffa92 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Action: 'create', calling method: .version_select at 0x7fa5084ef310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1433739659", "metadata": {"Type": "work"}}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fb613aa2-5fdb-4b99-b6ef-4b92eafffa92 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Request method failure captured: Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 122 Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rILTQe88-6qki99Z4QvBGsdcgYj0p9vlkxFt4t4Mzu8LXWFQfnoMDqZzulYzrNszXvaaQSRWYmKjwjH5HfWJGTkUFCDRqu9ROl5dcvXYz4_Tm5gP-XvGtM-yfmPqCrvrEl_X044qgxk0Kphm0g-TdJ8NLilfeVQp_19jrM_3NAEkwA Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:14:20.165679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cf283d0173e4c6f936c5b3a8ce18113"}]}] Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 748477083e514f32ac1d40f0fa84762b Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1433739659", "metadata": {"Type": "work"}}} Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: Aug 09 19:14:20.167032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1433739659', 'metadata': {'Type': 'work'}}}} Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise error Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:14:20.167700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 19:14:20.168828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 19:14:20.169819 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 19:14:20.169819 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.174697 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fb613aa2-5fdb-4b99-b6ef-4b92eafffa92 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:14:20.179623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fb613aa2-5fdb-4b99-b6ef-4b92eafffa92 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.572359 Aug 09 19:14:20.181672 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 26/44] 10.222.0.70 () {60 vars in 1156 bytes} [Tue Aug 9 19:14:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 578 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:14:20.371512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:20.411197 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-aff4e9a1-25cd-40a6-9554-a91a3a27a0a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.832383 Aug 09 19:14:20.419031 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-1f6135f1-1894-49c2-89f4-d43f848ee76a req-65caa029-1c5f-4949-836a-b96267f5a232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a736d74-42d3-4b24-b251-f869fbbefdaf", "tag": "48165766-24be-4025-a8b1-68cbba240dc4"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:20.425207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 19/45] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:19 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:20.443707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:20.446487 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1f6135f1-1894-49c2-89f4-d43f848ee76a req-65caa029-1c5f-4949-836a-b96267f5a232 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:20.447402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1f6135f1-1894-49c2-89f4-d43f848ee76a req-65caa029-1c5f-4949-836a-b96267f5a232 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:20.448373 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1f6135f1-1894-49c2-89f4-d43f848ee76a req-65caa029-1c5f-4949-836a-b96267f5a232 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:20.448752 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:20.464727 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:20.467458 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:20.469389 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:20.471958 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:20.475144 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:20.475819 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:20.486909 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-1f6135f1-1894-49c2-89f4-d43f848ee76a req-65caa029-1c5f-4949-836a-b96267f5a232 service nova] Creating event network-changed:48165766-24be-4025-a8b1-68cbba240dc4 for instance 5a736d74-42d3-4b24-b251-f869fbbefdaf on hv-cinder-85265 Aug 09 19:14:20.487772 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1f6135f1-1894-49c2-89f4-d43f848ee76a req-65caa029-1c5f-4949-836a-b96267f5a232 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117822) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 19:14:20.489063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1f6135f1-1894-49c2-89f4-d43f848ee76a req-65caa029-1c5f-4949-836a-b96267f5a232 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117822) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 19:14:20.491253 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce703e91-ed7e-47eb-a04b-bd4c5de0647e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:20.492089 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce703e91-ed7e-47eb-a04b-bd4c5de0647e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:20.492998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce703e91-ed7e-47eb-a04b-bd4c5de0647e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:20.494162 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce703e91-ed7e-47eb-a04b-bd4c5de0647e None None] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:20.494994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce703e91-ed7e-47eb-a04b-bd4c5de0647e None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:20.495699 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce703e91-ed7e-47eb-a04b-bd4c5de0647e None None] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:20.512313 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.compute.rpcapi [None req-ce703e91-ed7e-47eb-a04b-bd4c5de0647e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 19:14:20.513647 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce703e91-ed7e-47eb-a04b-bd4c5de0647e None None] Releasing lock "compute-rpcapi-router" {{(pid=117822) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 19:14:20.560554 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ce703e91-ed7e-47eb-a04b-bd4c5de0647e None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.376694 Aug 09 19:14:20.561746 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 27/46] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:14:20.571755 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-72099dfa-d1c4-4cfb-826b-a677e5229258 req-b55d60e4-11cd-4c8f-89dc-be846a79c8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5249124-ef8d-4931-8114-ad85549b447c", "tag": "02edcf89-39d2-4084-b64b-2b2ce84d06d8"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:20.588574 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-72099dfa-d1c4-4cfb-826b-a677e5229258 req-b55d60e4-11cd-4c8f-89dc-be846a79c8e1 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:20.589349 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-72099dfa-d1c4-4cfb-826b-a677e5229258 req-b55d60e4-11cd-4c8f-89dc-be846a79c8e1 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:20.590154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-72099dfa-d1c4-4cfb-826b-a677e5229258 req-b55d60e4-11cd-4c8f-89dc-be846a79c8e1 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:20.605265 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-72099dfa-d1c4-4cfb-826b-a677e5229258 req-b55d60e4-11cd-4c8f-89dc-be846a79c8e1 service nova] Creating event network-changed:02edcf89-39d2-4084-b64b-2b2ce84d06d8 for instance b5249124-ef8d-4931-8114-ad85549b447c on hv-cinder-85265 Aug 09 19:14:20.612071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-72099dfa-d1c4-4cfb-826b-a677e5229258 req-b55d60e4-11cd-4c8f-89dc-be846a79c8e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048297 Aug 09 19:14:20.614896 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 28/47] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:14:20.625399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9e504685-668d-4f09-85fa-74edad094715 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Action: 'create', calling method: .version_select at 0x7fa5084e4940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-624522046", "metadata": {"Type": "work"}}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9e504685-668d-4f09-85fa-74edad094715 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Request method failure captured: Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 119 Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rILTQe88-6qki99Z4QvBGsdcgYj0p9vlkxFt4t4Mzu8LXWFQfnoMDqZzulYzrNszXvaaQSRWYmKjwjH5HfWJGTkUFCDRqu9ROl5dcvXYz4_Tm5gP-XvGtM-yfmPqCrvrEl_X044qgxk0Kphm0g-TdJ8NLilfeVQp_19jrM_3NAEkwA Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:14:20.630799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cf283d0173e4c6f936c5b3a8ce18113"}]}] Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 748477083e514f32ac1d40f0fa84762b Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-624522046", "metadata": {"Type": "work"}}} Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: Aug 09 19:14:20.632096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-624522046', 'metadata': {'Type': 'work'}}}} Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise error Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi '0' Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:14:20.634211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 19:14:20.638841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 19:14:20.641706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 19:14:20.641706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:20.643174 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9e504685-668d-4f09-85fa-74edad094715 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:14:20.644478 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9e504685-668d-4f09-85fa-74edad094715 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.027946 Aug 09 19:14:20.645585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 29/48] 10.222.0.70 () {60 vars in 1156 bytes} [Tue Aug 9 19:14:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:14:20.652021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:20.653232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:20.662385 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:20.663606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:20.664553 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:20.665543 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:20.666686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:20.667814 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:21.237276 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:21.256239 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:21.258079 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:21.267088 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7085ffac-6af6-425b-888d-f1b2f73f1dbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.837979 Aug 09 19:14:21.269298 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 20/49] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:20 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:21.287672 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f99b11dc-2318-4ac6-b014-b0ea333082a4 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Action: 'create', calling method: .version_select at 0x7fa50848e1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-741603048", "metadata": {"Type": "work"}}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f99b11dc-2318-4ac6-b014-b0ea333082a4 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Request method failure captured: Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 118 Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rILTQe88-6qki99Z4QvBGsdcgYj0p9vlkxFt4t4Mzu8LXWFQfnoMDqZzulYzrNszXvaaQSRWYmKjwjH5HfWJGTkUFCDRqu9ROl5dcvXYz4_Tm5gP-XvGtM-yfmPqCrvrEl_X044qgxk0Kphm0g-TdJ8NLilfeVQp_19jrM_3NAEkwA Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:14:21.298682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cf283d0173e4c6f936c5b3a8ce18113"}]}] Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 748477083e514f32ac1d40f0fa84762b Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-741603048", "metadata": {"Type": "work"}}} Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: Aug 09 19:14:21.300256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-741603048', 'metadata': {'Type': 'work'}}}} Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise error Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi '' Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:14:21.300946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 19:14:21.302080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 19:14:21.303272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 19:14:21.303272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.305739 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f99b11dc-2318-4ac6-b014-b0ea333082a4 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:14:21.307858 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f99b11dc-2318-4ac6-b014-b0ea333082a4 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.037396 Aug 09 19:14:21.311723 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 21/50] 10.222.0.70 () {60 vars in 1156 bytes} [Tue Aug 9 19:14:21 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:14:21.320985 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d0c8fa94-560b-44a4-a6c1-f9ec904211ef tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Calling method '.version_select at 0x7fa508448280>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:21.400982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-d0c8fa94-560b-44a4-a6c1-f9ec904211ef tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] HTTP exception thrown: Volume tempest-invalid-1930040730 could not be found. Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d0c8fa94-560b-44a4-a6c1-f9ec904211ef tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Request method failure captured: Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1930040730 HTTP/1.1 Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rILTQe88-6qki99Z4QvBGsdcgYj0p9vlkxFt4t4Mzu8LXWFQfnoMDqZzulYzrNszXvaaQSRWYmKjwjH5HfWJGTkUFCDRqu9ROl5dcvXYz4_Tm5gP-XvGtM-yfmPqCrvrEl_X044qgxk0Kphm0g-TdJ8NLilfeVQp_19jrM_3NAEkwA Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:14:21.409613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cf283d0173e4c6f936c5b3a8ce18113"}]}] Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 748477083e514f32ac1d40f0fa84762b Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Volume tempest-invalid-1930040730 could not be found. Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'tempest-invalid-1930040730'} Aug 09 19:14:21.410798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1930040730 could not be found. (HTTP 404) (Request-ID: req-0062a783-efe3-4c11-ae99-30a2680ba924) Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.411463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 19:14:21.412410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1930040730 could not be found. Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:14:21.414772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1930040730 could not be found. Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1930040730 could not be found. Aug 09 19:14:21.417877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.419290 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d0c8fa94-560b-44a4-a6c1-f9ec904211ef tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Returning 404 to user: Volume tempest-invalid-1930040730 could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:14:21.419290 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d0c8fa94-560b-44a4-a6c1-f9ec904211ef tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1930040730" status: 404 len: 99 microversion: 2.1 time: 0.103003 Aug 09 19:14:21.423760 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 22/51] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Aug 9 19:14:21 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1930040730 => generated 99 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 09 19:14:21.450350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-37358ba6-8c27-4365-b531-fd5c7cdb7003 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022086 Aug 09 19:14:21.462956 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 23/52] 10.222.0.70 () {58 vars in 1140 bytes} [Tue Aug 9 19:14:21 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 19:14:21.470714 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:21.471390 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:21.506262 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:21.506866 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:21.515199 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:21.516058 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:21.516575 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:21.517016 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:21.656504 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:21.679686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-990b8e5c-f5e9-4f98-b9e6-03122804d46e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 1.032140 Aug 09 19:14:21.683188 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 30/53] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:20 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:21.699705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a08395ce-d163-4dbe-a634-7942d7ef37ad tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005677 Aug 09 19:14:21.705619 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 31/54] 10.222.0.70 () {58 vars in 1137 bytes} [Tue Aug 9 19:14:21 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 19:14:21.717562 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0c3ad36e-ff4d-41a8-8e81-faa68f4d3008 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Calling method '.version_select at 0x7fa5084d8310>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:21.767902 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-0c3ad36e-ff4d-41a8-8e81-faa68f4d3008 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] HTTP exception thrown: Volume 851c1a70-4e49-4c7e-b4fa-b310413e6756 could not be found. Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0c3ad36e-ff4d-41a8-8e81-faa68f4d3008 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Request method failure captured: Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/os-volumes/851c1a70-4e49-4c7e-b4fa-b310413e6756 HTTP/1.1 Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rILTQe88-6qki99Z4QvBGsdcgYj0p9vlkxFt4t4Mzu8LXWFQfnoMDqZzulYzrNszXvaaQSRWYmKjwjH5HfWJGTkUFCDRqu9ROl5dcvXYz4_Tm5gP-XvGtM-yfmPqCrvrEl_X044qgxk0Kphm0g-TdJ8NLilfeVQp_19jrM_3NAEkwA Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:14:21.772097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cf283d0173e4c6f936c5b3a8ce18113"}]}] Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 748477083e514f32ac1d40f0fa84762b Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Volume 851c1a70-4e49-4c7e-b4fa-b310413e6756 could not be found. Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '851c1a70-4e49-4c7e-b4fa-b310413e6756'} Aug 09 19:14:21.773752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 851c1a70-4e49-4c7e-b4fa-b310413e6756 could not be found. (HTTP 404) (Request-ID: req-02317c29-aef1-47ce-95ba-8e5950dd07fd) Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.774494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 19:14:21.780008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 851c1a70-4e49-4c7e-b4fa-b310413e6756 could not be found. Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 19:14:21.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 851c1a70-4e49-4c7e-b4fa-b310413e6756 could not be found. Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 851c1a70-4e49-4c7e-b4fa-b310413e6756 could not be found. Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0c3ad36e-ff4d-41a8-8e81-faa68f4d3008 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Returning 404 to user: Volume 851c1a70-4e49-4c7e-b4fa-b310413e6756 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0c3ad36e-ff4d-41a8-8e81-faa68f4d3008 tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/851c1a70-4e49-4c7e-b4fa-b310413e6756" status: 404 len: 109 microversion: 2.1 time: 0.060806 Aug 09 19:14:21.782306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 32/55] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:14:21 2022] DELETE /compute/v2.1/os-volumes/851c1a70-4e49-4c7e-b4fa-b310413e6756 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:14:21.788253 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b73f2815-cceb-4984-b2e8-9182cedc84ff tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Calling method '.version_select at 0x7fa5084d8e50>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:21.832238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-b73f2815-cceb-4984-b2e8-9182cedc84ff tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] HTTP exception thrown: Volume 6679f9de-298c-4a00-95ea-7a84aed18b5e could not be found. Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b73f2815-cceb-4984-b2e8-9182cedc84ff tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Request method failure captured: Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/os-volumes/6679f9de-298c-4a00-95ea-7a84aed18b5e HTTP/1.1 Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rILTQe88-6qki99Z4QvBGsdcgYj0p9vlkxFt4t4Mzu8LXWFQfnoMDqZzulYzrNszXvaaQSRWYmKjwjH5HfWJGTkUFCDRqu9ROl5dcvXYz4_Tm5gP-XvGtM-yfmPqCrvrEl_X044qgxk0Kphm0g-TdJ8NLilfeVQp_19jrM_3NAEkwA Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:14:21.834428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9cf283d0173e4c6f936c5b3a8ce18113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9cf283d0173e4c6f936c5b3a8ce18113"}]}] Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 9cf283d0173e4c6f936c5b3a8ce18113 Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesNegativeTest-631913629 Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 748477083e514f32ac1d40f0fa84762b Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesNegativeTest-631913629-project Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Volume 6679f9de-298c-4a00-95ea-7a84aed18b5e could not be found. Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '6679f9de-298c-4a00-95ea-7a84aed18b5e'} Aug 09 19:14:21.836008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6679f9de-298c-4a00-95ea-7a84aed18b5e could not be found. (HTTP 404) (Request-ID: req-5f4115d9-27aa-448b-8b1e-371359c970d2) Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.836848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:14:21.845218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6679f9de-298c-4a00-95ea-7a84aed18b5e could not be found. Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 19:14:21.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6679f9de-298c-4a00-95ea-7a84aed18b5e could not be found. Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6679f9de-298c-4a00-95ea-7a84aed18b5e could not be found. Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b73f2815-cceb-4984-b2e8-9182cedc84ff tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] Returning 404 to user: Volume 6679f9de-298c-4a00-95ea-7a84aed18b5e could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b73f2815-cceb-4984-b2e8-9182cedc84ff tempest-VolumesNegativeTest-631913629 tempest-VolumesNegativeTest-631913629-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/6679f9de-298c-4a00-95ea-7a84aed18b5e" status: 404 len: 109 microversion: 2.1 time: 0.053791 Aug 09 19:14:21.847503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 33/56] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:14:21 2022] GET /compute/v2.1/os-volumes/6679f9de-298c-4a00-95ea-7a84aed18b5e => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:14:21.870471 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:21.878693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-48170ea6-38b3-472e-b3ac-fe71ea7117fe tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.426622 Aug 09 19:14:21.890954 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 24/57] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:21 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:22.298870 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:22.299497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:22.309271 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:22.309949 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:22.311308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:22.312180 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:22.313129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:22.314011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:22.506227 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:22.519982 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:22.525522 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:22.526991 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2df41a94-c516-4c6b-85fb-6cea808cc51f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.235337 Aug 09 19:14:22.527561 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 34/58] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:22 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:22.582882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-ce31aa31-c2bc-455b-add6-b4423a8784a0 req-0f69935e-5ff0-4f85-9aff-300c69c9f9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "089e2228-15ef-4db1-bda3-9d4e892e9fd4", "tag": "0af10d4c-bcf4-4af0-bf75-1f4f109caa11"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:22.593082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-ce31aa31-c2bc-455b-add6-b4423a8784a0 req-0f69935e-5ff0-4f85-9aff-300c69c9f9e0 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:22.593785 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-ce31aa31-c2bc-455b-add6-b4423a8784a0 req-0f69935e-5ff0-4f85-9aff-300c69c9f9e0 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:22.594418 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-ce31aa31-c2bc-455b-add6-b4423a8784a0 req-0f69935e-5ff0-4f85-9aff-300c69c9f9e0 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:22.608801 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-ce31aa31-c2bc-455b-add6-b4423a8784a0 req-0f69935e-5ff0-4f85-9aff-300c69c9f9e0 service nova] Creating event network-changed:0af10d4c-bcf4-4af0-bf75-1f4f109caa11 for instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 on hv-cinder-85265 Aug 09 19:14:22.614375 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-ce31aa31-c2bc-455b-add6-b4423a8784a0 req-0f69935e-5ff0-4f85-9aff-300c69c9f9e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035454 Aug 09 19:14:22.615188 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 25/59] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:14:22.704472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:22.705199 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:22.714115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:22.715001 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:22.715645 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:22.717100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:22.721044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:22.721636 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:22.907624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:22.911663 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:22.930923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:22.931637 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:22.934965 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:22.935964 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:22.936921 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:22.937502 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:23.072920 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:23.078525 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=100 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:23.084344 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2db3233a-7a8a-4d07-9a64-6beddd505dcf tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.382807 Aug 09 19:14:23.099229 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 35/60] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:22 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:23.208725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:23.234960 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-202a2991-8d59-48e1-a2a2-e7baa0dccfd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.339266 Aug 09 19:14:23.235896 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 26/61] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:22 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:23.551402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:23.552001 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:23.559248 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:23.559248 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:23.559604 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:23.562482 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:23.562941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:23.563368 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:23.743197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:23.753483 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:23.755240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:23.757729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e62882ef-8262-41cb-ac06-c10c9d97019e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.209808 Aug 09 19:14:23.758400 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 36/62] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:23 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:24.105162 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:24.106392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:24.117398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:24.118004 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:24.118605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:24.119300 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:24.119745 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:24.120346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:24.259928 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:24.260817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:24.266011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:24.281941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:24.284962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:24.287785 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:24.291670 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:24.294044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:24.294840 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:24.317552 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:24.328168 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-68f28201-a325-4faa-ae29-6f4500a1bb6f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.227132 Aug 09 19:14:24.333481 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 27/63] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:24 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:24.723803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:24.732653 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c931d5cd-7bad-4209-a6b8-9a17bc95c84d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.478376 Aug 09 19:14:24.736669 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 37/64] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:24 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:24.780365 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:24.781003 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:24.797356 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:24.801944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:24.804658 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:24.807135 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:24.807745 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:24.810247 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:25.053442 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:25.065571 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:25.067475 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:25.069039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b247ca1f-0709-4d23-86ba-de923c918832 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.292863 Aug 09 19:14:25.087232 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 28/65] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:24 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:25.350961 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:25.351785 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:25.358056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:25.358640 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:25.359146 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:25.359906 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:25.360421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:25.360933 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:25.559349 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:25.569378 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-93b4abb9-4560-4a59-924a-4204cc23cacd tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.222377 Aug 09 19:14:25.584901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 38/66] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:25 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:25.758499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:25.759132 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:25.771324 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:25.772243 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:25.773560 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:25.774985 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:25.776795 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:25.777583 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:26.023256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:26.027485 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:26.032909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a8c43c0a-b9f6-4015-ac24-df0353a1c6be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.279361 Aug 09 19:14:26.033519 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 29/67] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:25 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:26.091790 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:26.092817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:26.099085 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:26.099710 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:26.100283 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:26.102278 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:26.102781 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:26.103215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:26.254762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:26.262982 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:26.264808 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:26.266308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-71458032-f480-4936-8187-9d795ee9425d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.178692 Aug 09 19:14:26.266880 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 39/68] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:26 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:26.596974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:26.596974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:26.600127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:26.600258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:26.601433 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:26.604198 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:26.605108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:26.605558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:26.771034 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:26.779214 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b9ce2fb6-9f0b-4744-b46b-74ecafdc5463 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.191258 Aug 09 19:14:26.779801 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 30/69] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:26 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:27.059039 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:27.059656 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:27.065789 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:27.066434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:27.067027 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:27.067945 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:27.068605 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:27.069213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:27.240619 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:27.248644 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e41ffd50-be73-4965-8ada-65763d2a9678 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.193459 Aug 09 19:14:27.249231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 40/70] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:27 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:27.289561 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:27.290179 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:27.296299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:27.296847 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:27.297227 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:27.297983 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:27.298431 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:27.298846 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:27.442334 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:27.451059 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:27.452634 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:27.453741 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5f1a2af8-19f8-46eb-a1de-d9911d7a3158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.168752 Aug 09 19:14:27.454314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 31/71] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:27 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:27.800976 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:27.801684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:27.808824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:27.809411 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:27.809983 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:27.810795 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:27.811240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:27.811662 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:28.050335 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:28.053319 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-717311d2-b034-4fd3-9442-6681d88371f6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.256455 Aug 09 19:14:28.054444 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 41/72] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:27 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:28.271639 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:28.273331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:28.282287 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:28.285170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:28.285938 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:28.286550 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:28.287562 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:28.288793 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:28.290393 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:28.457728 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:28.466426 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7a4fe3a8-8a07-474c-8786-894226f24c30 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.200420 Aug 09 19:14:28.467272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 32/73] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:28 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:28.477593 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:28.478204 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:28.487922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:28.488413 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:28.488895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:28.489602 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:28.490056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:28.490477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:28.636150 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:28.645192 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:28.646713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:28.648390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-dc443c2b-e0a9-4f99-9bec-3ebe9696e1a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.175149 Aug 09 19:14:28.648975 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 42/74] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:28 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:29.078958 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:29.079696 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:29.090538 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:29.092235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:29.092837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:29.093715 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:29.094202 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:29.094674 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:29.288296 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:29.298664 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a48b2e99-2fad-433b-9127-6bb5afb3f431 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.223974 Aug 09 19:14:29.299251 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 33/75] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:29 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:29.488159 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:29.489399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:29.495787 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:29.496328 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:29.496795 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:29.497449 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:29.497898 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:29.498320 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:29.670284 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:29.673927 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:29.674607 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:29.679454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-05cf137b-2cdd-4ce1-9349-30d43419afcb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.195490 Aug 09 19:14:29.680517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 43/76] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:29 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:29.683140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:29.683633 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:29.685328 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:29.686050 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:29.686502 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:29.688289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:29.838346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:29.846412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:29.847945 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:29.849078 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-137994aa-c596-470e-84c7-e59bea16eac6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.179419 Aug 09 19:14:29.849642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 34/77] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:29 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:30.322686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:30.323449 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:30.333099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:30.333766 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:30.334181 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:30.335314 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:30.335903 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:30.336328 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:30.490274 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:30.498390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-828fa203-9deb-4f71-8c00-2a199917d408 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.180928 Aug 09 19:14:30.499303 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 44/78] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:30 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:30.700476 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:30.701088 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:30.702932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:30.708044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:30.708548 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:30.708980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:30.709660 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:30.710615 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:30.711040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:30.845157 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:30.853399 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d50d858d-cfaa-4e9e-8253-a57b777b9017 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.156629 Aug 09 19:14:30.853954 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 35/79] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:30 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:30.874447 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:30.875056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:30.876909 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:30.882847 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:30.883325 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:30.883757 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:30.884459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:30.884913 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:30.885332 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:31.015882 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:31.023852 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:31.025388 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:31.026485 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-aad62de0-ac8f-4c20-b1d0-652c359f08e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.155908 Aug 09 19:14:31.027039 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 45/80] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:30 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:31.520117 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:31.520770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:31.527910 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:31.528392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:31.528934 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:31.529581 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:31.530017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:31.530433 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:31.666798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:31.674184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-be720016-de1c-44b9-9e7b-bee06b1062c2 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.157954 Aug 09 19:14:31.674761 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 36/81] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:31 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:31.875018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:31.875614 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:31.881597 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:31.882682 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:31.883256 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:31.883956 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:31.884401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:31.884844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:32.021217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:32.029771 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c496f77f-4074-4f2e-98ff-8e759be0871a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.158448 Aug 09 19:14:32.030336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 46/82] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:31 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:32.049396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:32.050424 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:32.057196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:32.057691 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:32.058127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:32.058876 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:32.059326 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:32.059751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:32.200536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:32.208870 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:32.210628 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:32.211894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b5bb2f62-a6e8-4d9a-a234-65e3570d98f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.166815 Aug 09 19:14:32.212417 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 37/83] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:32 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:32.702921 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:32.704167 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:32.736784 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:32.737926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:32.738532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:32.739424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:32.740480 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:32.741108 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:32.999316 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:33.010153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8bfb9cf4-c3d8-4d1b-89a2-3f040b2ecac5 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.316576 Aug 09 19:14:33.011298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 47/84] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:32 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:33.053297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:33.055048 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:33.063638 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:33.064643 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:33.065503 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:33.066372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:33.067084 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:33.067709 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:33.235091 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:33.235713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:33.248203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:33.248749 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:33.249356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:33.250069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:33.252740 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:33.253773 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:33.309117 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:33.321974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b8fc69a5-9d58-496f-8c6d-c4d9715a4353 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.273149 Aug 09 19:14:33.323247 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 38/85] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:33 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:33.480854 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:33.490348 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:33.492422 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:33.493677 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-32ad2169-fe97-4cc8-828b-c357142c38da tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.263428 Aug 09 19:14:33.494251 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 48/86] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:33 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:14:34.034937 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:34.036514 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:34.043653 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:34.044352 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:34.044941 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:34.045826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:34.046387 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:34.047288 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:34.212326 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:34.220561 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a0578d11-988b-4fed-84d8-5278ad79e458 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.190516 Aug 09 19:14:34.224577 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 39/87] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:34 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:34.344775 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:34.346442 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:34.352992 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:34.353693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:34.354132 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:34.354828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:34.355279 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:34.355702 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:34.516291 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:34.517082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:34.523850 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:34.524485 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:34.525293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:34.526088 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:34.526629 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:34.527143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:34.551334 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:34.565464 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-93172aee-eb4f-4ca3-9e78-5f694a524140 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.224407 Aug 09 19:14:34.572930 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 49/88] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:34 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:34.744612 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:34.753131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:34.754771 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:34.755915 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c3ef9a7f-cce5-424c-87c2-5f9c9b2469e3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.243670 Aug 09 19:14:34.769352 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 40/89] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:34 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:35.251321 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:35.252184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:35.259664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:35.260260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:35.260833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:35.261595 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:35.262125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:35.262593 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:35.432330 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:35.440497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-344c0dbe-4bb7-4a1b-99d7-356f845b70e9 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.202536 Aug 09 19:14:35.441310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 50/90] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:35 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:35.588295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:35.588964 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:35.594889 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:35.595374 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:35.595810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:35.596602 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:35.596982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:35.597576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:35.744253 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:35.753196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-505f4839-13c1-4eb3-9101-a917d9905b2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.169836 Aug 09 19:14:35.754120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 41/91] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:35 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:35.780943 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:35.781778 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:35.787763 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:35.788458 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:35.789085 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:35.789777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:35.790370 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:35.790937 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:35.930347 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:35.938565 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:35.940114 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:35.941256 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e2056fe6-1ad7-44f7-8afb-bd37f7e52941 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.164223 Aug 09 19:14:35.941853 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 51/92] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:35 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:36.464237 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:36.465104 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:36.480721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:36.481380 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:36.481911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:36.483680 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:36.484232 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:36.486498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:36.637971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:36.646184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7ffd934d-f519-419e-9516-d98eacc73610 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.187793 Aug 09 19:14:36.646868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 42/93] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:36 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:36.775701 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:36.776308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:36.782300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:36.782774 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:36.783203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:36.783883 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:36.784325 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:36.784773 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:36.803493 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=100 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:36.915057 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:36.922427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a65ba40f-c0c2-4f67-8590-b40da4fe37f8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.151110 Aug 09 19:14:36.922991 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 52/94] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:36 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:36.963947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:36.964658 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:36.970566 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:36.971049 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:36.971480 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:36.972164 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:36.972642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:36.973068 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:37.109825 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:37.117694 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:37.119195 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:37.120278 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-fe690fc9-e88a-4eca-9fc6-8995128ec117 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.160901 Aug 09 19:14:37.120878 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 43/95] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:36 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:37.669076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:37.669676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:37.675897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:37.676369 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:37.676817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:37.677518 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:37.678028 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:37.678445 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:37.814499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:37.822541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fe8b3bcb-5ae1-4838-9a75-eab7c468543b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.157394 Aug 09 19:14:37.823111 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 53/96] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:37 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:37.943695 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:37.944941 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:37.950908 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:37.951380 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:37.951806 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:37.952600 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:37.953045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:37.953466 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:38.080799 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:38.088803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-eaaed87e-85b7-4895-925f-191093dccd7d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.148964 Aug 09 19:14:38.089362 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 44/97] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:37 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:38.142669 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:38.143288 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:38.150450 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:38.150933 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:38.151366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:38.152056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:38.152539 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:38.153076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:38.282494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:38.290838 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:38.292384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:38.293517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ccbce62f-c623-4223-9178-e9d97ab913b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.154827 Aug 09 19:14:38.294072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 54/98] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:38 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:38.844134 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:38.844786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:38.851632 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:38.852075 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:38.852534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:38.853216 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:38.853663 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:38.854079 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:38.985156 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:38.992723 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c9818ff9-6b07-4ed5-82d3-5c5809e1fa72 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.152372 Aug 09 19:14:38.993290 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 45/99] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:38 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:39.109105 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:39.109716 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:39.115664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:39.116185 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:39.116962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:39.117695 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:39.118148 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:39.118572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:39.316321 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:39.317459 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:39.324380 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:39.324890 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:39.325314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:39.326025 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:39.326452 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:39.327090 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:39.346784 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:39.446115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:39.456054 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9621fefd-c433-48da-ab59-c4996e6a5681 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.350827 Aug 09 19:14:39.459365 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 55/100] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:39 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:40.076871 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-9231d86f-d5ea-483c-ba33-2db3a7a968ec req-d325fd9e-f7e0-4f2c-a803-378bc1c25926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a736d74-42d3-4b24-b251-f869fbbefdaf", "name": "network-vif-plugged", "status": "completed", "tag": "48165766-24be-4025-a8b1-68cbba240dc4"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:40.098794 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-9231d86f-d5ea-483c-ba33-2db3a7a968ec req-d325fd9e-f7e0-4f2c-a803-378bc1c25926 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:40.101607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-9231d86f-d5ea-483c-ba33-2db3a7a968ec req-d325fd9e-f7e0-4f2c-a803-378bc1c25926 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:40.103798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-9231d86f-d5ea-483c-ba33-2db3a7a968ec req-d325fd9e-f7e0-4f2c-a803-378bc1c25926 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:40.139960 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:40.145602 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-9231d86f-d5ea-483c-ba33-2db3a7a968ec req-d325fd9e-f7e0-4f2c-a803-378bc1c25926 service nova] Creating event network-vif-plugged:48165766-24be-4025-a8b1-68cbba240dc4 for instance 5a736d74-42d3-4b24-b251-f869fbbefdaf on hv-cinder-85265 Aug 09 19:14:40.153321 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:40.155541 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:40.157075 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d5839f50-1549-4d81-a9c7-56ee604f5eae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.844741 Aug 09 19:14:40.159042 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 46/101] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:39 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:14:40.163603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-9231d86f-d5ea-483c-ba33-2db3a7a968ec req-d325fd9e-f7e0-4f2c-a803-378bc1c25926 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176040 Aug 09 19:14:40.164508 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 56/102] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:14:40.164862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:40.165743 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:40.175233 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:40.175929 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:40.176786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:40.177752 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:40.179359 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:40.180079 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:40.480658 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:40.481576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:40.519001 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:40.519620 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:40.520061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:40.520789 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:40.521578 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:40.522218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:40.568074 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:40.583309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d58de066-e212-40d1-bb95-87c87103d080 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.422982 Aug 09 19:14:40.584815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 47/103] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:40 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:41.085655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:41.100002 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e77c71a9-8bc2-42fe-acbd-967bc2c69510 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.619277 Aug 09 19:14:41.100002 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 57/104] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:40 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:41.183113 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:41.183807 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:41.196051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:41.196788 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:41.197180 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:41.197962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:41.198480 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:41.199048 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:41.330141 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:41.338152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:41.339664 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:41.340788 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d5d95816-edcc-4b6a-a522-601d201659ab tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.162439 Aug 09 19:14:41.341351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 48/105] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:41 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:41.607454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:41.608062 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:41.614119 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:41.614589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:41.615015 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:41.615692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:41.616803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:41.617258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:41.752884 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:41.760561 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-39056267-5853-43fa-82d4-a0be923e536d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.157476 Aug 09 19:14:41.761044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 58/106] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:41 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:42.116189 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:42.116768 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:42.122753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:42.123237 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:42.123673 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:42.124367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:42.124846 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:42.125268 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:42.183497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-fdf544d6-5cbe-4663-baee-214b7a1c8a40 req-6fbaf4e3-5383-404f-a681-1e5e3f6d874e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39198df8-0086-49fa-9144-f42684a5513a", "name": "network-vif-plugged", "status": "completed", "tag": "3b8e268c-bee6-4a6b-b29d-7f00e37ebbf0"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:42.194025 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-fdf544d6-5cbe-4663-baee-214b7a1c8a40 req-6fbaf4e3-5383-404f-a681-1e5e3f6d874e service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:42.195188 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-fdf544d6-5cbe-4663-baee-214b7a1c8a40 req-6fbaf4e3-5383-404f-a681-1e5e3f6d874e service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:42.195831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-fdf544d6-5cbe-4663-baee-214b7a1c8a40 req-6fbaf4e3-5383-404f-a681-1e5e3f6d874e service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:42.211146 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-fdf544d6-5cbe-4663-baee-214b7a1c8a40 req-6fbaf4e3-5383-404f-a681-1e5e3f6d874e service nova] Creating event network-vif-plugged:3b8e268c-bee6-4a6b-b29d-7f00e37ebbf0 for instance 39198df8-0086-49fa-9144-f42684a5513a on hv-cinder-85265 Aug 09 19:14:42.216060 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-fdf544d6-5cbe-4663-baee-214b7a1c8a40 req-6fbaf4e3-5383-404f-a681-1e5e3f6d874e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037226 Aug 09 19:14:42.216767 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 59/107] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:14:42.265097 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:42.279515 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e04dec14-d1f6-46e0-8feb-a1e38cc30c92 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.167264 Aug 09 19:14:42.280092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 49/108] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:42 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:42.363706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:42.364402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:42.371558 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:42.371966 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:42.372394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:42.373176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:42.373627 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:42.374042 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:42.510394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:42.518858 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:42.520422 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:42.521573 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-06e78a61-2bf1-43f1-8009-736d21d7d475 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.162202 Aug 09 19:14:42.522138 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 60/109] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:42 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:42.781224 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:42.781826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:42.787787 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:42.789076 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:42.789661 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:42.790344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:42.790784 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:42.791196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:42.923130 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:42.930999 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5db61d41-8753-4094-9218-792f8bec63c7 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.153668 Aug 09 19:14:42.931569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 50/110] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:42 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:43.299018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:43.299955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:43.306453 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:43.306945 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:43.307455 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:43.308050 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:43.308587 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:43.313036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:43.436548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:43.443812 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f34514aa-4f0b-427c-8901-9501a030089f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.148594 Aug 09 19:14:43.445131 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 61/111] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:43 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:43.544942 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:43.545464 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:43.551600 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:43.552073 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:43.552515 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:43.553186 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:43.554146 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:43.554561 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:43.692354 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:43.701060 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:43.702575 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:43.703692 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f99f0f87-4fef-42b0-8ba0-91485c2c42d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.163004 Aug 09 19:14:43.704261 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 51/112] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:43 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:43.951141 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:43.951786 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:43.961961 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:43.962745 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:43.963233 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:43.963940 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:43.964394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:43.964844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:44.110218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:44.118551 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6541fe91-4cbb-4445-90a5-4e6a6fdcc997 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.171260 Aug 09 19:14:44.119155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 62/113] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:43 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:44.468750 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:44.469579 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:44.486689 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:44.489398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:44.489983 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:44.491623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:44.492194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:44.493052 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:44.684067 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:44.693395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-69e34fd9-50bd-41eb-89d5-36ad0f8a3379 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.230545 Aug 09 19:14:44.694027 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 52/114] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:44 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:44.727403 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:44.728009 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:44.734385 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:44.734886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:44.735316 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:44.736215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:44.736996 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:44.737487 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:44.911239 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:44.919354 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:44.920884 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:44.921983 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1aeef4c0-cc7a-4bfd-ae68-88853d6bc447 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.199935 Aug 09 19:14:44.922544 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 63/115] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:44 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:45.138888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:45.139509 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:45.145690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:45.146406 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:45.146990 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:45.148152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:45.148821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:45.149421 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:45.326589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:45.334127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d4a09fb0-ef06-4f4d-ac0b-d26dd7d18446 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.199000 Aug 09 19:14:45.334979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 53/116] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:45 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:45.715659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:45.716300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:45.722634 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:45.723365 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:45.723803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:45.724542 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:45.724993 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:45.726342 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:45.884073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:45.899760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-621126ce-1da6-474c-8219-98edc1ca5f8a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1321 microversion: 2.1 time: 0.188974 Aug 09 19:14:45.901107 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 64/117] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:45 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:45.947809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:45.950962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:45.959147 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:45.960800 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:45.961487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:45.962414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:45.963585 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:45.964216 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:46.326324 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:46.384636 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:46.394366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:46.415751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:46.424833 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:46.432430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:46.433634 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-283eecb1-f7eb-4bb5-b2f9-784c1a16b4e1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.489855 Aug 09 19:14:46.435125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:46.436014 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:46.436764 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 54/118] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:45 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:46.438806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:46.439840 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:46.440944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:46.451670 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-c7035ccc-c2d8-455d-a126-fea36389e53b req-6a72d70c-f4c7-46ea-afcc-c643f92a74cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5249124-ef8d-4931-8114-ad85549b447c", "name": "network-vif-plugged", "status": "completed", "tag": "02edcf89-39d2-4084-b64b-2b2ce84d06d8"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:46.489369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c7035ccc-c2d8-455d-a126-fea36389e53b req-6a72d70c-f4c7-46ea-afcc-c643f92a74cf service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:46.492029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c7035ccc-c2d8-455d-a126-fea36389e53b req-6a72d70c-f4c7-46ea-afcc-c643f92a74cf service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:46.492984 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c7035ccc-c2d8-455d-a126-fea36389e53b req-6a72d70c-f4c7-46ea-afcc-c643f92a74cf service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:46.512620 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-c7035ccc-c2d8-455d-a126-fea36389e53b req-6a72d70c-f4c7-46ea-afcc-c643f92a74cf service nova] Creating event network-vif-plugged:02edcf89-39d2-4084-b64b-2b2ce84d06d8 for instance b5249124-ef8d-4931-8114-ad85549b447c on hv-cinder-85265 Aug 09 19:14:46.527509 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-c7035ccc-c2d8-455d-a126-fea36389e53b req-6a72d70c-f4c7-46ea-afcc-c643f92a74cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086049 Aug 09 19:14:46.529639 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 55/119] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:14:46.822140 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:46.836001 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9d3a8678-ad9f-4ff4-9e8a-e0f1ee0c64cc tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.481552 Aug 09 19:14:46.836465 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 65/120] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:46 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:46.926420 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:46.935802 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:46.955716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:46.960648 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:46.961529 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:46.962718 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:46.963198 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:46.963656 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:47.213193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:47.223757 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4b865544-3fe1-4e1d-b4b6-da110bd8027a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1515 microversion: 2.1 time: 0.306331 Aug 09 19:14:47.224748 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 56/121] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:46 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1515 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:47.245862 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:47.248375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:47.255156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:47.255638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:47.256280 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:47.257668 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:47.258116 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:47.261472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:47.327076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lazy-loading 'flavor' on Instance uuid 39198df8-0086-49fa-9144-f42684a5513a {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:14:47.464397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:47.465062 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:47.494016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ce8d85f6-8fbb-410a-8ae2-e29cc1fc0a9f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a/action" status: 200 len: 32 microversion: 2.1 time: 0.250852 Aug 09 19:14:47.499576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 66/122] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:14:47 2022] POST /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:14:47.507629 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:47.508331 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:47.509857 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:47.510563 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:47.511378 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:47.512791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:47.513627 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:47.514256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:47.515453 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:47.515942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:47.516373 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:47.517097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:47.517547 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:47.517962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:47.705269 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:47.714666 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-7b2c58d7-5fb1-49c7-a390-73fbb2a8771b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.213465 Aug 09 19:14:47.715265 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 67/123] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:47 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:47.721435 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:47.730507 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:47.734930 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:47.736704 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-00e8883b-388c-4293-a055-22154c942f30 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.277155 Aug 09 19:14:47.737643 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 57/124] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:47 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:14:47.858736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:47.859344 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:47.867692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:47.868185 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:47.868643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:47.869495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:47.870179 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:47.870838 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:47.896999 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:48.052343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:48.067362 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-84bbd479-7018-4162-9d1d-9e323e17ee8e tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.212707 Aug 09 19:14:48.080491 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 68/125] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:47 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:48.551923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-64a68ca3-3048-43f8-b2e4-3cb59c8b7e4c req-b6f3b883-22f3-438f-9d63-0ccb002ea741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089e2228-15ef-4db1-bda3-9d4e892e9fd4", "name": "network-vif-plugged", "status": "completed", "tag": "0af10d4c-bcf4-4af0-bf75-1f4f109caa11"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:48.563184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-64a68ca3-3048-43f8-b2e4-3cb59c8b7e4c req-b6f3b883-22f3-438f-9d63-0ccb002ea741 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:48.564165 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-64a68ca3-3048-43f8-b2e4-3cb59c8b7e4c req-b6f3b883-22f3-438f-9d63-0ccb002ea741 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:48.564623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-64a68ca3-3048-43f8-b2e4-3cb59c8b7e4c req-b6f3b883-22f3-438f-9d63-0ccb002ea741 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:48.576586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-64a68ca3-3048-43f8-b2e4-3cb59c8b7e4c req-b6f3b883-22f3-438f-9d63-0ccb002ea741 service nova] Creating event network-vif-plugged:0af10d4c-bcf4-4af0-bf75-1f4f109caa11 for instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 on hv-cinder-85265 Aug 09 19:14:48.581574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-64a68ca3-3048-43f8-b2e4-3cb59c8b7e4c req-b6f3b883-22f3-438f-9d63-0ccb002ea741 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035847 Aug 09 19:14:48.582389 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 58/126] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:14:48.740617 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:48.741405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:48.747263 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:48.747762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:48.748403 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:48.749133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:48.749575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:48.749987 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:48.761714 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:48.762642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:48.768844 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:48.769498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:48.770096 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:48.770932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:48.771529 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:48.772807 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:48.921217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:48.929127 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d4d0274c-2cf4-417e-9d11-3799d9a28d6f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.192195 Aug 09 19:14:48.930662 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 69/127] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:48 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:48.932321 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:48.943574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:48.945777 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:48.947266 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2acb0614-d7e6-45ef-923d-15b039f96778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.189530 Aug 09 19:14:48.948384 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 59/128] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:48 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:14:49.100733 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:49.102287 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:49.109585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:49.111097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:49.111546 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:49.112242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:49.112714 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:49.113146 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:49.279815 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:49.289841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-57cc4ad3-7398-40bc-99c9-f78f3dfd5a82 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.192889 Aug 09 19:14:49.290286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 70/129] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:49 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:49.952740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:49.953506 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:49.961506 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:49.961993 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:49.962427 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:49.963127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:49.963690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:49.964118 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:49.971326 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:49.972139 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:49.978356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:49.978842 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:49.979269 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:49.979955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:49.980398 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:49.981249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:50.228992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:50.233813 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:50.237142 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b80cb6fd-5f69-43a8-aca9-9d441735e8a3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.289196 Aug 09 19:14:50.237724 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 60/130] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:49 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:50.242015 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:50.243611 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:50.244827 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-626b196a-ce5c-40c0-9e37-46ade595a55e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.277615 Aug 09 19:14:50.245434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 71/131] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:49 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:14:50.312000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:50.312379 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:50.318420 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:50.319108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:50.319438 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:50.320212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:50.320685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:50.321102 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:50.454399 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:50.462390 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-909b4788-6f90-4b88-b5e6-10397be9d14d tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.154492 Aug 09 19:14:50.462894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 61/132] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:50 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:51.258784 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:51.259392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:51.265521 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:51.266006 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:51.266443 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:51.266842 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:51.267224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:51.267487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:51.267579 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:51.267979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:51.274431 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:51.274923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:51.275355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:51.276043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:51.276545 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:51.276954 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:51.408044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:51.414034 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:51.417210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:51.418762 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:51.419866 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8b0c0289-48ff-4d1d-a7fa-bc365485830f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.156893 Aug 09 19:14:51.420421 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 62/133] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:51 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:14:51.424178 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ade95d18-b821-46f4-9be8-4673cc3f63aa tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.169680 Aug 09 19:14:51.425027 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 72/134] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:51 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:51.482699 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:51.483234 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:51.489228 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:51.489704 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:51.490125 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:51.490842 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:51.491357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:51.491775 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:51.626837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:51.634621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-307848c5-d513-427b-9a37-c5f53d4ae5e3 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.155731 Aug 09 19:14:51.635187 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 63/135] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:51 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:52.441614 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:52.442226 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:52.446193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:52.447287 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:52.449151 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:52.449640 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:52.450070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:52.450767 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:52.451214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:52.451634 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:52.453919 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:52.454410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:52.455005 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:52.456097 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:52.456613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:52.457044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:52.477262 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:52.601212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:52.602106 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:52.609541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:52.609725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f3dfdbb9-7234-4154-888d-9204001a35f5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.168699 Aug 09 19:14:52.610205 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 64/136] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:52 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:52.611051 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:52.612154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e805f5cb-4b22-44b9-be15-23751b044621 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.174546 Aug 09 19:14:52.612750 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 73/137] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:52 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:52.654762 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:52.655375 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:52.661326 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:52.661805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:52.662235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:52.663090 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:52.663637 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:52.664059 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:52.804328 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:52.812132 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-296ec5a7-c628-4d7d-9f95-3adf46bc4b4a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.161111 Aug 09 19:14:52.812737 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 65/138] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:52 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:53.634708 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:53.634708 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:53.635307 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:53.635307 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:53.643165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:53.643818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:53.643967 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:53.644082 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:53.644823 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:53.645221 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:53.645336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:53.645817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:53.646226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:53.647061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:53.647862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:53.648706 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:53.813917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:53.820677 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:53.822971 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5d12cbe2-7ce6-4218-8ab3-5e75e1ac1bf1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.195356 Aug 09 19:14:53.823563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 74/139] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:53 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:53.832201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:53.833412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:53.833791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:53.834021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:53.835216 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e2cb0a0d-1ba8-44a2-846a-a0988d2bf1b6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1405 microversion: 2.20 time: 0.204714 Aug 09 19:14:53.835888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 66/140] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:53 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:14:53.841273 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:53.841762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:53.842198 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:53.842892 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:53.843343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:53.843767 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:54.007975 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:54.017648 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-113625a5-7207-4d50-8a4c-eadb58314f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1314 microversion: 2.1 time: 0.188032 Aug 09 19:14:54.018230 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 75/141] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:53 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:14:54.847489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:54.848330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:54.859296 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:54.860709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:54.863938 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=78 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:14:54.871478 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:54.873713 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:54.874462 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:54.875066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:54.875767 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:54.876269 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:54.876725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:54.891897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:54.891897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:54.891897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:54.891897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:54.892232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:55.063117 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:55.073093 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:55.074682 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:55.076095 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2615f57f-b783-4fd9-9e41-ef26a72bc53b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1596 microversion: 2.20 time: 0.222608 Aug 09 19:14:55.077030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 76/142] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:14:54 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1596 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:14:55.081736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:55.082333 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:55.089806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:55.090308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:55.090746 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:55.091475 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:55.092094 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:55.092566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:55.114293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:55.127587 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-225a93c9-6f62-4af4-b284-4aba040ed442 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.285305 Aug 09 19:14:55.133277 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 67/143] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:54 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:55.138888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e1d500dc-a232-4a07-b45d-223bc7f4ec34 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:55.139561 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e1d500dc-a232-4a07-b45d-223bc7f4ec34 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:55.145525 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1d500dc-a232-4a07-b45d-223bc7f4ec34 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:55.146025 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1d500dc-a232-4a07-b45d-223bc7f4ec34 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:55.151128 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1d500dc-a232-4a07-b45d-223bc7f4ec34 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:55.152070 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1d500dc-a232-4a07-b45d-223bc7f4ec34 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:55.152569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1d500dc-a232-4a07-b45d-223bc7f4ec34 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:55.153811 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1d500dc-a232-4a07-b45d-223bc7f4ec34 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:55.254325 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:55.264552 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fee2ac4f-db04-46df-b7d3-0ebac1a28f0a tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1501 microversion: 2.1 time: 0.186296 Aug 09 19:14:55.265231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 77/144] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:55 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1501 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:55.281530 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e1d500dc-a232-4a07-b45d-223bc7f4ec34 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146427 Aug 09 19:14:55.282258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 68/145] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Aug 9 19:14:55 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:14:56.157354 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:56.158703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:56.165824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:56.166323 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:56.166780 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:56.167684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:56.168156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:56.168860 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:56.419754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:56.441586 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d2e4be03-4171-453a-a85a-641ad08e98b3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.291194 Aug 09 19:14:56.442171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 78/146] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:56 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:56.914396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-6aa2e018-cdf5-44a0-8897-08522e62b56c req-0a222a72-0594-44e2-86fd-9cfd5b1ff929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5249124-ef8d-4931-8114-ad85549b447c", "tag": "02edcf89-39d2-4084-b64b-2b2ce84d06d8"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:56.923613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-6aa2e018-cdf5-44a0-8897-08522e62b56c req-0a222a72-0594-44e2-86fd-9cfd5b1ff929 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:56.924087 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-6aa2e018-cdf5-44a0-8897-08522e62b56c req-0a222a72-0594-44e2-86fd-9cfd5b1ff929 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:56.924808 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-6aa2e018-cdf5-44a0-8897-08522e62b56c req-0a222a72-0594-44e2-86fd-9cfd5b1ff929 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:56.937961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-6aa2e018-cdf5-44a0-8897-08522e62b56c req-0a222a72-0594-44e2-86fd-9cfd5b1ff929 service nova] Creating event network-changed:02edcf89-39d2-4084-b64b-2b2ce84d06d8 for instance b5249124-ef8d-4931-8114-ad85549b447c on hv-cinder-85265 Aug 09 19:14:56.943454 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-6aa2e018-cdf5-44a0-8897-08522e62b56c req-0a222a72-0594-44e2-86fd-9cfd5b1ff929 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033869 Aug 09 19:14:56.944245 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 69/147] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:14:57.467687 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:57.468302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:57.474451 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:57.475536 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:57.476238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:57.477493 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:57.478431 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:57.478858 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:57.660223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:57.669209 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8ef50d3f-1ec7-4ead-94fa-a92691bfa8be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.205861 Aug 09 19:14:57.669209 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 79/148] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:57 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:58.690856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:58.691560 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:58.699281 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:58.699970 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:58.700464 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:58.701224 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:58.702494 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:58.703069 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:58.839762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9d4092ea-e091-4946-b254-dcc2c1924334 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f357e135-b46e-4cfb-b56b-78dbbfc63da3"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:14:58.849188 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9d4092ea-e091-4946-b254-dcc2c1924334 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:58.863934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d4092ea-e091-4946-b254-dcc2c1924334 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:58.864684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d4092ea-e091-4946-b254-dcc2c1924334 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:58.865259 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d4092ea-e091-4946-b254-dcc2c1924334 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:58.866385 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d4092ea-e091-4946-b254-dcc2c1924334 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:58.867043 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d4092ea-e091-4946-b254-dcc2c1924334 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:14:58.867730 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9d4092ea-e091-4946-b254-dcc2c1924334 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:14:58.956131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:14:58.969494 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d776741e-28fa-4e04-b116-5ee2758ce10a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.282582 Aug 09 19:14:58.983703 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 70/149] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:58 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:14:59.389051 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9d4092ea-e091-4946-b254-dcc2c1924334 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "POST /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.561332 Aug 09 19:14:59.390869 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 80/150] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:14:58 2022] POST /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4/os-volume_attachments => generated 194 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:14:59.992195 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:14:59.992952 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:14:59.999092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:14:59.999577 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:00.000054 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:00.000900 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:00.001855 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:00.001855 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:00.136576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:00.144075 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-34c06b7c-f348-4094-b976-81bf2ef1b4ee tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.156574 Aug 09 19:15:00.144856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 71/151] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:14:59 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:01.167957 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:01.168669 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:01.179249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:01.179594 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:01.180040 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:01.180911 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:01.181691 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:01.182264 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:01.369382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:01.376935 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-7c37fc78-8b23-444d-84b3-3e93ee49eb23 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.215147 Aug 09 19:15:01.377506 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 81/152] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:01 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:02.401985 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:02.403569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:02.406315 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=74 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:02.412827 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:02.414027 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:02.415070 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:02.416084 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:02.416796 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:02.417623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:02.617155 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:02.626195 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7927e96c-c46f-43f7-8750-3bf58753c3ae tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.229583 Aug 09 19:15:02.626779 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 72/153] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:02 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:03.646184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:03.647091 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:03.653692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:03.654255 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:03.654769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:03.655457 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:03.656076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:03.656526 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:03.807625 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:03.815996 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d627151c-c076-439d-b28d-b46ebc5b3ba3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.173745 Aug 09 19:15:03.816616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 82/154] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:03 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:04.839697 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:04.840345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:04.849330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:04.849887 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:04.850326 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:04.851551 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:04.852208 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:04.852667 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:05.044151 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:05.054554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a9834cdc-8176-4449-b03d-561913194760 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.220688 Aug 09 19:15:05.056053 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 73/155] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:04 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:06.076935 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:06.078209 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:06.085943 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:06.086429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:06.086859 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:06.087558 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:06.088006 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:06.088429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:06.227275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:06.230857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:06.235546 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f4a14f81-9679-41f2-89c4-030a40fe553c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.162998 Aug 09 19:15:06.236471 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 83/156] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:06 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:07.258772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:07.260806 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:07.270675 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:07.271586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:07.272740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:07.273614 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:07.274222 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:07.274852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:07.485997 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:07.498732 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ed3a32b1-93bc-456d-8d18-007063225238 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.245447 Aug 09 19:15:07.500472 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 74/157] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:07 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:07.730064 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-809241913", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "networks": [{"uuid": "e7f84c10-3eb9-40bc-aa13-50f0d29be851"}]}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:07.826915 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] validate_networks() for [('e7f84c10-3eb9-40bc-aa13-50f0d29be851', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:15:08.364737 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:15:08.365791 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:15:08.366253 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:15:08.367440 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:15:08.368247 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:15:08.384220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:08.384722 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:08.386022 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:08.386896 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:08.387748 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:08.389214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:08.413299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Getting quotas for project d11b2b1481db4b878ceee550360da8fe. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:15:08.421757 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Getting quotas for user eef1ea8d331444e892d0b30c1feef904 and project d11b2b1481db4b878ceee550360da8fe. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:15:08.438573 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:15:08.441139 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:15:08.496908 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d7dd3f82-8f11-4c83-83b2-7e05592be3a7 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772291 Aug 09 19:15:08.503119 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 84/158] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:15:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:15:08.513395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7d9234a5-2c56-4841-9cd4-31942e25bb85 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:08.514557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7d9234a5-2c56-4841-9cd4-31942e25bb85 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:08.523494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:08.524242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:08.542865 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:08.544482 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:08.545563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:08.546468 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:08.547081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:08.547902 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:08.641854 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7d9234a5-2c56-4841-9cd4-31942e25bb85 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:08.654403 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7d9234a5-2c56-4841-9cd4-31942e25bb85 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1213 microversion: 2.1 time: 0.149478 Aug 09 19:15:08.658258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 75/159] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:08 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:08.806476 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:08.814352 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-74128cf2-2efa-42de-ab20-e10e6fd7796f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.296956 Aug 09 19:15:08.814909 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 85/160] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:08 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:09.399396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:09.399917 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:09.409664 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:09.410164 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:09.410821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:09.411676 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:09.412912 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:09.413209 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:09.442957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:15:09.564221 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e70f86b2-7845-4b33-acb3-74609abe7ea6 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "DELETE /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 204 len: 0 microversion: 2.1 time: 0.168951 Aug 09 19:15:09.564973 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 76/161] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:15:09 2022] DELETE /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:15:09.574646 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:09.575490 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:09.581942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:09.582699 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:09.583310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:09.584199 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:09.584834 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:09.585600 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:09.681935 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:09.682636 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:09.690526 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:09.690984 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:09.691441 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:09.692239 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:09.692647 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:09.693242 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:09.783458 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:09.791351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:09.798909 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fc80845c-41ba-48eb-8b96-5252f3352bbb tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1553 microversion: 2.1 time: 0.227530 Aug 09 19:15:09.800775 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 86/162] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:09 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:09.805701 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-fda44c22-0c20-42a9-b6e1-a5c68cd0cd0b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1265 microversion: 2.1 time: 0.129874 Aug 09 19:15:09.806368 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 77/163] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:09 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1265 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:09.836626 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:09.837183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:09.843083 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:09.843770 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:09.844388 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:09.845291 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:09.845901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:09.846572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:10.095663 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:10.108955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4b6bf84c-122f-4fbd-aea5-90f5ee5653b5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.276933 Aug 09 19:15:10.110975 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 87/164] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:09 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:10.828717 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:10.830332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:10.841635 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:10.842950 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:10.873899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:10.874399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:10.874856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:10.875537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:10.875989 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:10.876413 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:10.882688 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:10.884099 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:10.884804 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:10.886198 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:10.886811 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:10.887390 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:10.996904 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:11.004612 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2236be5e-d481-45b5-9f4e-63491a072666 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1273 microversion: 2.1 time: 0.169991 Aug 09 19:15:11.006584 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 88/165] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:10 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:11.112499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:11.123586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4af92f55-d593-44c2-94ca-3d1967729a9f tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1553 microversion: 2.1 time: 0.300853 Aug 09 19:15:11.124452 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 78/166] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:10 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1553 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:11.132574 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:11.133183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:11.144704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:11.145398 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:11.146079 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:11.147000 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:11.147601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:11.148239 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:11.327018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:11.337938 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-681fa558-6f0b-4432-96a5-a32aa49f0da6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.209254 Aug 09 19:15:11.338397 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 89/167] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:11 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:12.027171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:12.028849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:12.039190 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:12.041020 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:12.041446 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:12.044744 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:12.045371 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:12.045800 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:12.147566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:12.149810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:12.156449 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:12.156957 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:12.157835 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:12.158611 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:12.159151 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:12.159906 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:12.261029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:12.285483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4f19fc38-887b-48ad-9c84-0ca72c56b063 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1271 microversion: 2.1 time: 0.261321 Aug 09 19:15:12.289486 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 79/168] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:12 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:12.361703 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:12.362619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:12.372409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:12.373051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:12.373798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:12.374990 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:12.375444 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:12.375862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:12.558680 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:12.572687 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4b90308e-58ff-403a-9e01-a8fc61c46f62 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1553 microversion: 2.1 time: 0.430956 Aug 09 19:15:12.576767 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 90/169] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:12 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1553 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:12.919625 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:12.935478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-dad9ae3a-7b3d-4da9-92ea-90a20b4e04c7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.579148 Aug 09 19:15:12.954190 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 80/170] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:12 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:13.313370 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:13.313971 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:13.333166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:13.335713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:13.337402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:13.340769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:13.341429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:13.342014 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:13.370263 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-2327b1f7-66e3-464e-a49f-1b51b6ec8994 req-6d152cde-854c-4436-b82f-f864a434ca17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089e2228-15ef-4db1-bda3-9d4e892e9fd4", "name": "network-vif-deleted", "tag": "0af10d4c-bcf4-4af0-bf75-1f4f109caa11"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:13.401459 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-2327b1f7-66e3-464e-a49f-1b51b6ec8994 req-6d152cde-854c-4436-b82f-f864a434ca17 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:13.403651 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-2327b1f7-66e3-464e-a49f-1b51b6ec8994 req-6d152cde-854c-4436-b82f-f864a434ca17 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:13.405349 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-2327b1f7-66e3-464e-a49f-1b51b6ec8994 req-6d152cde-854c-4436-b82f-f864a434ca17 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:13.465184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-2327b1f7-66e3-464e-a49f-1b51b6ec8994 req-6d152cde-854c-4436-b82f-f864a434ca17 service nova] Creating event network-vif-deleted:0af10d4c-bcf4-4af0-bf75-1f4f109caa11 for instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 on hv-cinder-85265 Aug 09 19:15:13.485698 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-2327b1f7-66e3-464e-a49f-1b51b6ec8994 req-6d152cde-854c-4436-b82f-f864a434ca17 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111200 Aug 09 19:15:13.486783 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 81/171] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:15:13.608026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:13.609190 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:13.619474 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:13.623173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:13.624097 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:13.625902 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:13.641593 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:13.643868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:13.695193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:13.785738 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5464533ccfb74094bf613bcd51c55ff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df78df5c522b42b1b40aebf2502866e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:13.815896 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5780630d-9c8e-48a7-8bd6-fa449313419b tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 200 len: 1345 microversion: 2.1 time: 0.219300 Aug 09 19:15:13.824372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 82/172] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:13 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 1345 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:13.910018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:13.932268 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-94cc2c30-f92c-4195-ba89-ac08884de43f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1313 microversion: 2.1 time: 0.622893 Aug 09 19:15:13.933561 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 91/173] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:13 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:13.963171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:13.964025 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:13.976003 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:13.976671 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:13.976942 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:13.977646 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:13.978190 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:13.978496 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:13.990029 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-d6692f8a-b6cc-48de-be28-9689d2973232 req-77f26d4c-4d57-4c39-9359-c78ab50b4b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb", "tag": "973fcf80-247d-440b-80bb-bef54ba2e43d"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:14.020116 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-d6692f8a-b6cc-48de-be28-9689d2973232 req-77f26d4c-4d57-4c39-9359-c78ab50b4b36 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:14.022941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-d6692f8a-b6cc-48de-be28-9689d2973232 req-77f26d4c-4d57-4c39-9359-c78ab50b4b36 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:14.023390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-d6692f8a-b6cc-48de-be28-9689d2973232 req-77f26d4c-4d57-4c39-9359-c78ab50b4b36 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:14.057897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-d6692f8a-b6cc-48de-be28-9689d2973232 req-77f26d4c-4d57-4c39-9359-c78ab50b4b36 service nova] Creating event network-changed:973fcf80-247d-440b-80bb-bef54ba2e43d for instance d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb on hv-cinder-85265 Aug 09 19:15:14.069141 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-d6692f8a-b6cc-48de-be28-9689d2973232 req-77f26d4c-4d57-4c39-9359-c78ab50b4b36 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082657 Aug 09 19:15:14.074800 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 92/174] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:15:14.338838 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:14.347020 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b9a9f08d-9596-403b-9d07-378ffe59f40e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.390535 Aug 09 19:15:14.347898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 83/175] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:13 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:14.846810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:14.847531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:14.857256 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:14.857989 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:14.858654 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:14.859667 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:14.860324 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:14.860974 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:14.890021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] HTTP exception thrown: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Request method failure captured: Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 HTTP/1.1 Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH4Z5pYlegXQtl8OpnGTfnlK1FWS2hSdgAv15q4CxiQA3_zDDN_R_2qrA03VaoCTktjtZu0b28wt7CDPoZMRSarblTu8uqhNet_L4-_KA9obBMC8EKK7kCu0uZmZxkorcKlm1xE6dpoJ_W-C7MxzWWzzaxUzLlfjLqHNTzxXpCsqAA Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: df78df5c522b42b1b40aebf2502866e7 Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:15:14.897300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df78df5c522b42b1b40aebf2502866e7"}]}] Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: df78df5c522b42b1b40aebf2502866e7 Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-DeleteServersTestJSON-1931061439-project Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 5464533ccfb74094bf613bcd51c55ff1 Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-DeleteServersTestJSON-1931061439-project Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:14.899030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '089e2228-15ef-4db1-bda3-9d4e892e9fd4'} Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:15:14.899944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:14.901343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:14.902521 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Returning 404 to user: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:15:14.903669 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-50d704a9-c1a2-4969-a480-ebd9200c2fe4 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 404 len: 111 microversion: 2.1 time: 0.062450 Aug 09 19:15:14.904871 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 93/176] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:14 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:15:14.956894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:14.957517 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:14.971548 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:14.972038 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:14.973034 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:14.973748 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:14.976181 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:14.976725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:15.069513 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:15.072760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:15.080986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:15.081841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:15.082462 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:15.083384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:15.084613 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:15.085179 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:15.100811 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] HTTP exception thrown: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Request method failure captured: Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4/os-volume_attachments HTTP/1.1 Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH4Z5pYlegXQtl8OpnGTfnlK1FWS2hSdgAv15q4CxiQA3_zDDN_R_2qrA03VaoCTktjtZu0b28wt7CDPoZMRSarblTu8uqhNet_L4-_KA9obBMC8EKK7kCu0uZmZxkorcKlm1xE6dpoJ_W-C7MxzWWzzaxUzLlfjLqHNTzxXpCsqAA Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: df78df5c522b42b1b40aebf2502866e7 Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:15:15.103099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df78df5c522b42b1b40aebf2502866e7"}]}] Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: df78df5c522b42b1b40aebf2502866e7 Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-DeleteServersTestJSON-1931061439-project Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 5464533ccfb74094bf613bcd51c55ff1 Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-DeleteServersTestJSON-1931061439-project Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:15.104258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'server_id': '089e2228-15ef-4db1-bda3-9d4e892e9fd4'} Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:15:15.105020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:15.106129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:15.108904 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Returning 404 to user: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:15:15.110502 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-31ad6d15-1dae-48ee-b615-4c84bbab11ab tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052130 Aug 09 19:15:15.111642 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 94/177] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:15:15 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:15:15.189522 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:15.197988 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-74c51a75-b24d-40bc-92ca-968c9ba52bd3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1313 microversion: 2.1 time: 0.246986 Aug 09 19:15:15.198979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 84/178] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:14 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:15.371327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:15.371946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:15.387993 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:15.387993 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:15.387993 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:15.387993 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:15.388418 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:15.388418 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:15.609260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:15.619604 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-079ffb17-d212-4d5b-9d4a-5f6303789ea6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.252819 Aug 09 19:15:15.620345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 95/179] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:15 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:15.919612 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1778112867", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "networks": [{"uuid": "08408500-a901-4055-95fc-9e38338c0e51"}]}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:15.977427 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] validate_networks() for [('08408500-a901-4055-95fc-9e38338c0e51', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:15:16.222982 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:16.224483 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:16.248857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.249546 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.250289 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.251304 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.251962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.252562 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.438344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:15:16.438760 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:15:16.439224 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:15:16.439624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:15:16.440027 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:15:16.449544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.450021 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.450451 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.451168 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.451612 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.452345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.470225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Getting quotas for project 37a9557289ea4fe9903f6cf421d937d1. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:15:16.473784 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:16.475414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Getting quotas for user 871ff162be0b43c98b531e860f6a02e5 and project 37a9557289ea4fe9903f6cf421d937d1. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:15:16.482985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-36724d4b-94db-4108-ab4c-e387316b7dc0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1313 microversion: 2.1 time: 0.263759 Aug 09 19:15:16.483753 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 96/180] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:16 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:16.496811 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:15:16.496811 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:15:16.502106 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:16.502855 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:16.509555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.510038 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.510445 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.511137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.511873 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.512478 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.535197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] HTTP exception thrown: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Request method failure captured: Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 HTTP/1.1 Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH4Z5pYlegXQtl8OpnGTfnlK1FWS2hSdgAv15q4CxiQA3_zDDN_R_2qrA03VaoCTktjtZu0b28wt7CDPoZMRSarblTu8uqhNet_L4-_KA9obBMC8EKK7kCu0uZmZxkorcKlm1xE6dpoJ_W-C7MxzWWzzaxUzLlfjLqHNTzxXpCsqAA Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: df78df5c522b42b1b40aebf2502866e7 Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:15:16.537555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df78df5c522b42b1b40aebf2502866e7"}]}] Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: df78df5c522b42b1b40aebf2502866e7 Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-DeleteServersTestJSON-1931061439-project Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 5464533ccfb74094bf613bcd51c55ff1 Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-DeleteServersTestJSON-1931061439-project Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.538963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '089e2228-15ef-4db1-bda3-9d4e892e9fd4'} Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:15:16.539610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.540664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.543026 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Returning 404 to user: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:15:16.545137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-191eca01-8ba5-4ed3-923a-f511f39c8f85 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "DELETE /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 404 len: 111 microversion: 2.1 time: 0.046305 Aug 09 19:15:16.546379 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 97/181] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:15:16 2022] DELETE /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:15:16.557174 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:16.558509 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] [instance: 089e2228-15ef-4db1-bda3-9d4e892e9fd4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:16.565570 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.566110 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8d227162-6115-466f-95c4-c2a9e105c561 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649655 Aug 09 19:15:16.566548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.572766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 85/182] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:15:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:15:16.573624 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.574728 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.576181 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.576652 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.580082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-27eee2de-e7e4-41a9-8329-4b724f0da3e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:16.580740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-27eee2de-e7e4-41a9-8329-4b724f0da3e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:16.597179 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] HTTP exception thrown: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Request method failure captured: Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 HTTP/1.1 Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH4Z5pYlegXQtl8OpnGTfnlK1FWS2hSdgAv15q4CxiQA3_zDDN_R_2qrA03VaoCTktjtZu0b28wt7CDPoZMRSarblTu8uqhNet_L4-_KA9obBMC8EKK7kCu0uZmZxkorcKlm1xE6dpoJ_W-C7MxzWWzzaxUzLlfjLqHNTzxXpCsqAA Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: df78df5c522b42b1b40aebf2502866e7 Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:15:16.601196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/df78df5c522b42b1b40aebf2502866e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_df78df5c522b42b1b40aebf2502866e7"}]}] Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: df78df5c522b42b1b40aebf2502866e7 Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-DeleteServersTestJSON-1931061439 Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-DeleteServersTestJSON-1931061439-project Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 5464533ccfb74094bf613bcd51c55ff1 Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-DeleteServersTestJSON-1931061439-project Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.602477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '089e2228-15ef-4db1-bda3-9d4e892e9fd4'} Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:15:16.603115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. Aug 09 19:15:16.604124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:15:16.605071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] Returning 404 to user: Instance 089e2228-15ef-4db1-bda3-9d4e892e9fd4 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:15:16.605071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ea18b371-f57b-4ee0-93b7-c9dcf058f077 tempest-DeleteServersTestJSON-1931061439 tempest-DeleteServersTestJSON-1931061439-project] 10.222.0.70 "GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4" status: 404 len: 111 microversion: 2.1 time: 0.052708 Aug 09 19:15:16.605071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 98/183] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:16 2022] GET /compute/v2.1/servers/089e2228-15ef-4db1-bda3-9d4e892e9fd4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 19:15:16.646909 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:16.648425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:16.658257 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.658995 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.659431 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.660576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:16.661008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:16.663734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:16.694825 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-27eee2de-e7e4-41a9-8329-4b724f0da3e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:16.707317 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-27eee2de-e7e4-41a9-8329-4b724f0da3e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1219 microversion: 2.1 time: 0.132384 Aug 09 19:15:16.713740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 86/184] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:16 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1219 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:16.948382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:16.967453 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5b63cdad-4192-4f45-a04c-25c08ff49af6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.329845 Aug 09 19:15:16.968265 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 99/185] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:16 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:17.507879 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:17.508587 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:17.520412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:17.520930 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:17.521938 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:17.522648 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:17.529237 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:17.530641 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:17.719368 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:17.734544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a0151d73-7a9a-46f6-9dd2-ba2ebca9b6ac tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1313 microversion: 2.1 time: 0.227057 Aug 09 19:15:17.748271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 87/186] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:17 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:17.751371 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:17.762429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:17.781065 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:17.781548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:17.782163 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:17.785817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:17.788971 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:17.789410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:17.895122 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:17.905254 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8baef211-1b80-41a0-8718-2e8312cf525f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1271 microversion: 2.1 time: 0.174619 Aug 09 19:15:17.919292 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 100/187] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:17 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:17.993571 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:17.994710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:18.004341 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:18.005690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:18.006957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:18.008122 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:18.009122 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:18.009770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:18.240969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:18.252140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e1268799-ca4a-4f89-b33f-ea86f903e41a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.264426 Aug 09 19:15:18.253108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 88/188] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:17 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:18.758230 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:18.759736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:18.764078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:18.764924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=6 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:18.786276 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:18.786864 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:18.787754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:18.789785 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:18.791081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:18.791822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:18.926210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:18.926817 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:18.936251 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:18.941906 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:18.942542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:18.944430 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:18.947986 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:18.950126 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:19.048963 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:19.059406 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-15164312-f3c9-4cb0-92b3-62e61e9c709e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1277 microversion: 2.1 time: 0.137454 Aug 09 19:15:19.060636 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 89/189] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:18 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:19.198795 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:19.207394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-020f3777-c066-4dff-a553-6611117e7b8e tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1313 microversion: 2.1 time: 0.455640 Aug 09 19:15:19.217160 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 101/190] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:18 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:19.280257 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:19.280950 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:19.301574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:19.301574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:19.301574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:19.301574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:19.301931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:19.301931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:19.504413 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:19.514077 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-fc029918-f8c4-45b3-9699-3ee30e98d5db tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.243799 Aug 09 19:15:19.528355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 90/191] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:19 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:20.085589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:20.086215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:20.099086 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:20.099789 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:20.100063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:20.101025 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:20.101639 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:20.102219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:20.233414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:20.234343 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:20.247756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:20.248658 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:20.249789 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:20.250974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:20.251606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:20.252386 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:20.327017 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:20.338410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2d0f418f-96d8-4694-a931-5b044dabbaff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.257189 Aug 09 19:15:20.339001 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 102/192] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:20 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:20.504850 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-f93e837c-dbdc-47e2-885e-b981288433c5 req-b16fdb29-5a7e-49ab-8711-be308b2c88d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb", "name": "network-vif-plugged", "status": "completed", "tag": "973fcf80-247d-440b-80bb-bef54ba2e43d"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:20.526298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-f93e837c-dbdc-47e2-885e-b981288433c5 req-b16fdb29-5a7e-49ab-8711-be308b2c88d8 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:20.527053 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-f93e837c-dbdc-47e2-885e-b981288433c5 req-b16fdb29-5a7e-49ab-8711-be308b2c88d8 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:20.527631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-f93e837c-dbdc-47e2-885e-b981288433c5 req-b16fdb29-5a7e-49ab-8711-be308b2c88d8 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:20.553298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-f93e837c-dbdc-47e2-885e-b981288433c5 req-b16fdb29-5a7e-49ab-8711-be308b2c88d8 service nova] Creating event network-vif-plugged:973fcf80-247d-440b-80bb-bef54ba2e43d for instance d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb on hv-cinder-85265 Aug 09 19:15:20.567460 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-f93e837c-dbdc-47e2-885e-b981288433c5 req-b16fdb29-5a7e-49ab-8711-be308b2c88d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066398 Aug 09 19:15:20.569017 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 103/193] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:15:20.574759 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:20.575643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:20.586899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:20.592988 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:20.593598 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:20.594498 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:20.598572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:20.599228 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:20.672656 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:20.685125 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-9d0e6aea-d714-4118-a64e-4850df2f6d2b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1313 microversion: 2.1 time: 0.457650 Aug 09 19:15:20.686975 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 91/194] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:20 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:20.863077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:20.872908 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6f2fd585-9e7d-4742-b8e2-8ab3d102c3a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.302127 Aug 09 19:15:20.874047 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 104/195] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:20 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:21.363202 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:21.364708 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:21.372206 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:21.372948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:21.374350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:21.375246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:21.376062 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:21.377093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:21.648417 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:21.661542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-58c69804-e499-48de-be04-b836c7a0df8f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.303778 Aug 09 19:15:21.663370 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 92/196] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:21 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:21.709559 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:21.710211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:21.717454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:21.718160 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:21.719245 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:21.720142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:21.720850 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:21.721471 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:21.743647 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=100 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:21.895300 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:21.896931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:21.907050 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:21.909431 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:21.912849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:21.913867 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:21.916308 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:21.917733 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:21.923833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:21.933744 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-61955a66-4dd6-41c5-84f9-bb185e52eb24 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1313 microversion: 2.1 time: 0.228394 Aug 09 19:15:21.934322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 105/197] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:21 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:22.193790 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:22.203410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0b9453fe-90d8-4af9-9b6c-c364a19f9072 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.312564 Aug 09 19:15:22.219914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 93/198] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:21 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:22.683887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:22.684514 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:22.691794 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:22.692291 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:22.692754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:22.694075 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:22.694603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:22.695022 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:22.878809 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:22.892464 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4d8ee940-cde0-48e8-b5b9-ce7eab189cac tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.212311 Aug 09 19:15:22.893265 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 106/199] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:22 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:22.956717 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:22.957555 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:22.967775 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:22.968803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:22.969946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:22.971432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:22.971948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:22.972575 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:23.237059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:23.240786 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:23.266541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:23.268399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:23.269100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:23.270032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:23.271491 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:23.272395 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:23.307093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:23.325539 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-afe6d7ad-4f0c-4a10-9944-f9c5d33393a0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1313 microversion: 2.1 time: 0.373955 Aug 09 19:15:23.326552 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 94/200] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:22 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:23.641437 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:23.653557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a3e9f145-3d75-4ade-8596-d6ce7e91d33d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.422602 Aug 09 19:15:23.654733 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 107/201] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:23 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:23.916386 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:23.917413 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:23.925803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:23.926293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:23.926768 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:23.928018 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:23.928714 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:23.929235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:24.076750 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-1316a43f-1059-421a-a65d-595f9dca4219 req-c8582381-06c2-4296-b944-9049987572bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9", "tag": "6dc7356a-6680-4ca1-9249-40bd42680544"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:24.108028 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1316a43f-1059-421a-a65d-595f9dca4219 req-c8582381-06c2-4296-b944-9049987572bb service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:24.108928 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1316a43f-1059-421a-a65d-595f9dca4219 req-c8582381-06c2-4296-b944-9049987572bb service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:24.110628 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1316a43f-1059-421a-a65d-595f9dca4219 req-c8582381-06c2-4296-b944-9049987572bb service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:24.124596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-1316a43f-1059-421a-a65d-595f9dca4219 req-c8582381-06c2-4296-b944-9049987572bb service nova] Creating event network-changed:6dc7356a-6680-4ca1-9249-40bd42680544 for instance 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 on hv-cinder-85265 Aug 09 19:15:24.132091 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-1316a43f-1059-421a-a65d-595f9dca4219 req-c8582381-06c2-4296-b944-9049987572bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059380 Aug 09 19:15:24.133595 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 108/202] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:15:24.280329 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:24.295261 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ff625a8a-682d-420e-b2a3-601457ca59e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.383835 Aug 09 19:15:24.296410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 95/203] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:23 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:24.347394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:24.348099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:24.355676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:24.356160 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:24.356638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:24.357335 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:24.357788 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:24.358204 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:24.590623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:24.600229 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-7770160c-1ef3-43e5-bfbd-eb430522b6ea tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1313 microversion: 2.1 time: 0.256432 Aug 09 19:15:24.613572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 109/204] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:24 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:24.676428 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:24.678461 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:24.685055 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:24.685675 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:24.686176 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:24.686982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:24.687501 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:24.688018 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:24.846967 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:24.856611 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c19efef6-1a20-42d1-930e-4bbf9020f47b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1521 microversion: 2.1 time: 0.185225 Aug 09 19:15:24.858158 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 96/205] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:24 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:25.321666 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:25.322423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:25.325242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:25.331165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:25.333326 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:25.333921 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:25.334950 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:25.335439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:25.335868 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:25.504052 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:25.522405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ad80a690-7cc3-4746-a20a-3ec5c8885033 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.206852 Aug 09 19:15:25.525212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 110/206] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:25 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:25.624795 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:25.625469 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:25.637017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:25.637017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:25.637206 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:25.637997 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:25.638554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:25.639018 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:25.880539 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:25.881823 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:25.894664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:25.895278 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:25.896957 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:25.908917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:25.909638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:25.911379 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:25.966040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:25.977952 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-65eabdf4-a6c9-4a32-902d-3f8fa1dd23d3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1496 microversion: 2.1 time: 0.358543 Aug 09 19:15:25.998391 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 97/207] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:25 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1496 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:26.426618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:26.437821 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a0c317ee-3f9f-452b-98e3-44296cece29f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1501 microversion: 2.1 time: 0.560592 Aug 09 19:15:26.440954 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 111/208] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:25 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1501 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:26.467367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:26.467751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:26.475705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:26.484501 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:26.485287 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:26.485712 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:26.491374 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:26.492195 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:26.494587 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:26.548370 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:26.548998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:26.562047 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:26.562752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:26.564700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:26.566853 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:26.571240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:26.571240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:26.700070 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=10 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:26.932190 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:26.940385 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fb208d82-3492-4661-bcaf-63fc5c4f83ee tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.395938 Aug 09 19:15:26.941734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 112/209] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:26 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:26.947072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:26.948125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:26.956563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:26.957282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:26.958046 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:26.959478 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:26.960342 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:26.961862 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:27.003608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:15:27.134890 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-93a3c548-c038-4e12-b621-4d858d7287cb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 204 len: 0 microversion: 2.1 time: 0.191649 Aug 09 19:15:27.136397 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 113/210] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:15:26 2022] DELETE /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:15:27.148131 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:27.150443 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:27.160878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:27.162452 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:27.163700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:27.165249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:27.166165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:27.166871 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:27.311520 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:27.341756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8d4c1700-ef72-41c7-a6fc-2e075c5f9e54 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1516 microversion: 2.1 time: 0.868127 Aug 09 19:15:27.350598 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 98/211] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:26 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1516 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:27.540770 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:27.555550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-89f58889-febe-4dba-aef8-05d31481c982 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1502 microversion: 2.1 time: 0.411886 Aug 09 19:15:27.556459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 114/212] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:27 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:27.962776 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:27.964015 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:27.985882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:27.986383 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:27.986821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:27.987527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:27.988211 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:27.988398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:28.323636 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:28.344316 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1d63ef8f-25b4-46ac-8b3a-02d5c587830f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.385693 Aug 09 19:15:28.346224 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 99/213] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:27 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:28.580604 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:28.581323 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:28.592103 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:28.595863 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:28.596312 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:28.597074 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:28.597535 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:28.597960 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:28.814935 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:28.826027 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e63f411c-90c0-4ff5-a80c-d8ce2f9ec004 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1502 microversion: 2.1 time: 0.249410 Aug 09 19:15:28.827524 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 115/214] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:28 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:29.368768 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:29.369605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:29.385747 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:29.389532 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:29.390563 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:29.393799 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:29.394389 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:29.396991 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:29.442613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:29.648201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:29.665669 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8ce5445d-d631-401a-8cb0-ad2087070f23 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.302169 Aug 09 19:15:29.666276 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 100/215] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:29 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:29.856794 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:29.856794 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:29.866703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:29.867548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:29.868218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:29.869272 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:29.870810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:29.871859 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:30.065861 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:30.075230 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-521d8192-ca8b-4dd6-8f16-f85266cefc95 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1502 microversion: 2.1 time: 0.226582 Aug 09 19:15:30.075830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 116/216] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:29 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:30.691111 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:30.694477 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:30.713774 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:30.714321 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:30.716657 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:30.717411 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:30.717870 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:30.718292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:31.027303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:31.038673 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-030f33c8-9a60-4873-8ea6-02df9a70736d tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.354679 Aug 09 19:15:31.039390 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 101/217] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:30 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:31.103414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:31.105937 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:31.122345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:31.123887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:31.126818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:31.133216 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:31.135913 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:31.136958 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:31.743931 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:31.757334 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-27994da4-c765-4272-8136-634da08c58fd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1502 microversion: 2.1 time: 0.661389 Aug 09 19:15:31.761883 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 117/218] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:31 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1502 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:32.060144 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:32.060780 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:32.071286 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:32.071804 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:32.072246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:32.072986 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:32.073444 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:32.073864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:32.460538 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:32.468333 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3650529a-da1c-4206-be76-72fffd5e380f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.411842 Aug 09 19:15:32.476203 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 102/219] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:32 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:32.508299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:32.514772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:32.540162 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:32.544767 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:32.547503 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:32.549295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:32.553978 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:32.554625 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:32.556838 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:32.672730 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lazy-loading 'flavor' on Instance uuid 5a736d74-42d3-4b24-b251-f869fbbefdaf {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:15:32.745259 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-347bc119-5421-43e0-82e2-e43d72c8bc04 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'create', calling method: .version_select at 0x7fa50817a9d0>, body: {"keypair": {"name": "tempest-keypair-1159376809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKytwAByHCBudATxkQrSZ4cg8BrTaOvdBS0NaUsbKUrVcFUM4CZd5xdXM49MRI4dwbnBIhFU7GjJzV9weQZ3E3RZVuB+ldECLoEIZQjOqG2VaLXW5ExSttgQnWbNGXbyug=="}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:32.818790 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-347bc119-5421-43e0-82e2-e43d72c8bc04 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Getting quotas for project 56cc04948356488f8722a735954fd650. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:15:32.836195 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-347bc119-5421-43e0-82e2-e43d72c8bc04 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Getting quotas for user 05147fb1762748ee9866ccc5bff4d514 and project 56cc04948356488f8722a735954fd650. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:15:32.953631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-347bc119-5421-43e0-82e2-e43d72c8bc04 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.596682 Aug 09 19:15:32.954245 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 118/220] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:15:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:15:32.977696 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:32.979961 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:32.995414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:32.999002 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:32.999707 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:33.001620 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:33.002848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:33.006049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:33.076891 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-07eb2068-79e7-4376-95b6-48d0b7519fa2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf/action" status: 200 len: 32 microversion: 2.1 time: 0.576262 Aug 09 19:15:33.077502 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 103/221] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:15:32 2022] POST /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf/action => generated 32 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:15:33.084111 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-c6ae296a-f2a6-4e3f-9dc2-5b4b7e8555f8 req-20fa2f2f-f3a0-4b9e-b3db-9c828d61e3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb", "name": "network-vif-deleted", "tag": "973fcf80-247d-440b-80bb-bef54ba2e43d"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:33.084986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:33.085609 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:33.086039 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:33.086485 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lazy-loading 'fault' on Instance uuid d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:15:33.096453 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c6ae296a-f2a6-4e3f-9dc2-5b4b7e8555f8 req-20fa2f2f-f3a0-4b9e-b3db-9c828d61e3dc service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:33.097166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c6ae296a-f2a6-4e3f-9dc2-5b4b7e8555f8 req-20fa2f2f-f3a0-4b9e-b3db-9c828d61e3dc service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:33.097741 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c6ae296a-f2a6-4e3f-9dc2-5b4b7e8555f8 req-20fa2f2f-f3a0-4b9e-b3db-9c828d61e3dc service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:33.113877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-c6ae296a-f2a6-4e3f-9dc2-5b4b7e8555f8 req-20fa2f2f-f3a0-4b9e-b3db-9c828d61e3dc service nova] Creating event network-vif-deleted:973fcf80-247d-440b-80bb-bef54ba2e43d for instance d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb on hv-cinder-85265 Aug 09 19:15:33.119953 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-c6ae296a-f2a6-4e3f-9dc2-5b4b7e8555f8 req-20fa2f2f-f3a0-4b9e-b3db-9c828d61e3dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040725 Aug 09 19:15:33.121082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 104/222] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:15:33.128152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:33.129791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:33.141292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:33.141891 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:33.142399 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:33.143194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:33.144101 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:33.144711 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:33.183558 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:33.196770 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-786cef4d-d659-4221-bae8-7fc53a8bfec6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 200 len: 1303 microversion: 2.1 time: 0.231299 Aug 09 19:15:33.197942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 119/223] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:32 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 1303 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:33.226176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-a828e6e1-260e-408e-91bf-a9db2e156a46 req-8f3196a7-29e9-4340-aa23-3295d8781f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9", "name": "network-vif-plugged", "status": "completed", "tag": "6dc7356a-6680-4ca1-9249-40bd42680544"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:33.243064 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-a828e6e1-260e-408e-91bf-a9db2e156a46 req-8f3196a7-29e9-4340-aa23-3295d8781f64 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:33.243544 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-a828e6e1-260e-408e-91bf-a9db2e156a46 req-8f3196a7-29e9-4340-aa23-3295d8781f64 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:33.244105 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-a828e6e1-260e-408e-91bf-a9db2e156a46 req-8f3196a7-29e9-4340-aa23-3295d8781f64 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:33.259646 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-a828e6e1-260e-408e-91bf-a9db2e156a46 req-8f3196a7-29e9-4340-aa23-3295d8781f64 service nova] Creating event network-vif-plugged:6dc7356a-6680-4ca1-9249-40bd42680544 for instance 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 on hv-cinder-85265 Aug 09 19:15:33.270402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-a828e6e1-260e-408e-91bf-a9db2e156a46 req-8f3196a7-29e9-4340-aa23-3295d8781f64 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052495 Aug 09 19:15:33.271579 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 120/224] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:15:33.470971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:33.492716 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:33.495363 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:33.499859 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-66e33ca7-bb78-44c3-b4e4-35d6714d80a7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.375951 Aug 09 19:15:33.501363 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 105/225] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:33 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:33.512709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:33.515267 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:33.515992 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:33.518398 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:33.520278 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:33.527083 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:34.162485 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:34.176696 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-50102122-45ee-4ccc-b954-fb79024d51e5 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.687234 Aug 09 19:15:34.177741 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 121/226] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:33 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:34.223650 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:34.225181 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:34.236323 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:34.246267 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:34.247914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:34.249412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:34.250340 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:34.251241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:34.270010 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] HTTP exception thrown: Instance d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb could not be found. Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Request method failure captured: Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb HTTP/1.1 Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rI4ZVHpP7UEdoWNCzrwgRj0gRjG3p57rXq_oMmIwKQXcBspaBazRRdajqeVQCr7VwRi7VB9n1ejJWUkI08p9lsiWevGDgJ59_JWCUz1KE0fF_hgBaktvfLgq4xibLFep4Qp5vk9C1swJIQADXez0WPr9kJ1PtP0qc6nU8fXTQrdZrY Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: d11b2b1481db4b878ceee550360da8fe Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-VolumesActionsTest-1816687812 Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:15:34.277000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d11b2b1481db4b878ceee550360da8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d11b2b1481db4b878ceee550360da8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d11b2b1481db4b878ceee550360da8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d11b2b1481db4b878ceee550360da8fe"}]}] Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-VolumesActionsTest-1816687812 Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: d11b2b1481db4b878ceee550360da8fe Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-VolumesActionsTest-1816687812 Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-VolumesActionsTest-1816687812-project Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: eef1ea8d331444e892d0b30c1feef904 Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-VolumesActionsTest-1816687812-project Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb could not be found. Aug 09 19:15:34.278483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'd63aa4ff-0c62-41d7-87ed-6ac09dfd54fb'} Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb could not be found. Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:15:34.279238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb could not be found. Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb could not be found. Aug 09 19:15:34.280609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:15:34.283628 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Returning 404 to user: Instance d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:15:34.284497 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4b8decbb-17fc-4418-be74-016d8bb9011b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb" status: 404 len: 111 microversion: 2.1 time: 0.068917 Aug 09 19:15:34.288336 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 106/227] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:34 2022] GET /compute/v2.1/servers/d63aa4ff-0c62-41d7-87ed-6ac09dfd54fb => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:15:34.524287 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:34.525189 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:34.539925 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:34.542661 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:34.543495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:34.545873 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:34.546805 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:34.547836 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:34.562176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:34.706710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1432282470", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "networks": [{"uuid": "e7f84c10-3eb9-40bc-aa13-50f0d29be851"}]}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:34.840243 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] validate_networks() for [('e7f84c10-3eb9-40bc-aa13-50f0d29be851', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:15:34.991617 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:35.001443 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1b0edc9b-2a4b-42e9-bf32-dc4734919f2d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.483487 Aug 09 19:15:35.016213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 122/228] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:34 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:35.200625 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:35.201179 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:35.231133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:35.232733 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:35.233581 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:35.234487 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:35.235299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:35.236044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:35.538273 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:35.548073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-18a88531-3a86-42e7-8d5b-4f6153df9f92 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1319 microversion: 2.1 time: 0.352864 Aug 09 19:15:35.552778 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 123/229] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:35 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:35.788539 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:15:35.789813 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:15:35.790394 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:15:35.791284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:15:35.791887 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:15:35.808078 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:35.808955 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:35.809631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:35.810562 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:35.811907 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:35.812669 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:35.845364 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Getting quotas for project d11b2b1481db4b878ceee550360da8fe. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:15:35.851920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Getting quotas for user eef1ea8d331444e892d0b30c1feef904 and project d11b2b1481db4b878ceee550360da8fe. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:15:35.867651 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:15:35.870405 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:15:35.943950 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-075450dc-d345-4c2a-97a4-6472d5f171bd tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.240957 Aug 09 19:15:35.948578 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 107/230] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 19:15:35.955994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fe43d56d-5458-4604-bf2f-7ee37136f148 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:35.963673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fe43d56d-5458-4604-bf2f-7ee37136f148 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:36.024229 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:36.024885 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:36.039715 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:36.040226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:36.042788 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:36.043671 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:36.044145 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:36.053043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:36.070220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fe43d56d-5458-4604-bf2f-7ee37136f148 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:36.077183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fe43d56d-5458-4604-bf2f-7ee37136f148 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1214 microversion: 2.1 time: 0.124930 Aug 09 19:15:36.077756 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 124/231] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:35 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:36.344302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-428718894", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f60b7e99-fc43-4c9b-b9a0-a693e8be0c61"}], "security_groups": [{"name": "tempest-securitygroup--481048043"}], "key_name": "tempest-keypair-1159376809", "user_data": "}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:36.463907 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:36.471746 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-034591c3-1b65-48f5-96fa-ec4515a86bea tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.452547 Aug 09 19:15:36.484466 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 108/232] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:36 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:36.587903 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:36.594030 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:36.604722 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:36.606173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:36.608517 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:36.610394 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:36.612522 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:36.615460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:36.665690 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] validate_networks() for [('f60b7e99-fc43-4c9b-b9a0-a693e8be0c61', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:15:36.787815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:36.803882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-83febf15-fc6d-4a05-8a40-2722db5806f0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1508 microversion: 2.1 time: 0.225656 Aug 09 19:15:36.820751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 109/233] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:36 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:37.101001 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:37.101001 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:37.124965 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:37.125516 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:37.125950 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:37.128944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:37.129428 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:37.129858 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:37.210536 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:15:37.210964 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:15:37.211438 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:15:37.211849 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:15:37.212258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:15:37.223266 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:37.223790 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:37.224367 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:37.225359 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:37.225813 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:37.226240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:37.246333 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Getting quotas for project 56cc04948356488f8722a735954fd650. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:15:37.250518 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Getting quotas for user 05147fb1762748ee9866ccc5bff4d514 and project 56cc04948356488f8722a735954fd650. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:15:37.260817 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:37.270104 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:15:37.273645 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:15:37.275947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6b1985e9-a06d-493f-83aa-f2d4d37b627f tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1266 microversion: 2.1 time: 0.180443 Aug 09 19:15:37.277172 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 110/234] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:37 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:37.338769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e1b88c72-f6aa-4b2e-a891-01569efa1380 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.000872 Aug 09 19:15:37.342231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 125/235] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:15:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 19:15:37.353580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ce094f52-a11c-4e0b-badc-955123853544 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:37.356807 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ce094f52-a11c-4e0b-badc-955123853544 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:37.455556 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ce094f52-a11c-4e0b-badc-955123853544 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:37.467556 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ce094f52-a11c-4e0b-badc-955123853544 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1237 microversion: 2.1 time: 0.118086 Aug 09 19:15:37.468640 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 111/236] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:37 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1237 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:37.515138 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:37.516429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:37.530281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:37.532265 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:37.532818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:37.534980 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:37.536058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:37.537679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:37.977369 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:37.986567 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-788a5a4c-a1c1-4433-a14d-5eef24780687 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.475246 Aug 09 19:15:37.988984 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 126/237] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:37 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:38.298690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:38.299644 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:38.318346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:38.318991 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:38.319435 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:38.320159 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:38.320741 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:38.321172 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:38.477246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:38.491863 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-faf1f6b9-5c7e-43db-a32d-63543f423c41 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1272 microversion: 2.1 time: 0.196668 Aug 09 19:15:38.495340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:38.496196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:38.510643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:38.511282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 112/238] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:38 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:38.511885 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:38.512578 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:38.513538 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:38.516409 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:38.517542 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:38.691495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:38.704244 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2cccf2d0-6f82-40d5-9bbd-719299b925f6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1233 microversion: 2.1 time: 0.212957 Aug 09 19:15:38.705964 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 127/239] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:38 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1233 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:39.014407 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:39.015203 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:39.028743 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:39.031250 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:39.033009 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:39.035712 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:39.037061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:39.041313 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:39.304035 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:39.320944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-14fddc13-4d5d-4949-afee-77e6dc76f98b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.313704 Aug 09 19:15:39.322210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 113/240] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:39 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:39.533595 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:39.534923 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:39.544747 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:39.545831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:39.546633 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:39.547662 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:39.548316 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:39.549238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:39.729848 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:39.731267 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:39.738340 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:39.739114 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:39.739871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:39.740786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:39.741419 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:39.742040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:39.842488 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:39.853649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-01bdaf1a-0502-4f17-adac-b765ac4844a6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1295 microversion: 2.1 time: 0.130243 Aug 09 19:15:39.866103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 114/241] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:39 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1295 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:39.906829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:39.915184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3f073b66-6fee-4e91-a3ae-fe5ce10e41bf tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.385761 Aug 09 19:15:39.915767 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 128/242] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:39 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:40.247782 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-925ffbd5-67c8-491b-933d-983c7db4da76 req-3733570d-2957-4615-a8f4-86546fdc48cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b61d3a-a4ec-45c1-a0d4-2a290704afe1", "tag": "7f3ec950-db3f-43e9-99f5-4a919a371957"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:40.261131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-925ffbd5-67c8-491b-933d-983c7db4da76 req-3733570d-2957-4615-a8f4-86546fdc48cc service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:40.261609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-925ffbd5-67c8-491b-933d-983c7db4da76 req-3733570d-2957-4615-a8f4-86546fdc48cc service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:40.262035 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-925ffbd5-67c8-491b-933d-983c7db4da76 req-3733570d-2957-4615-a8f4-86546fdc48cc service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:40.289134 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-925ffbd5-67c8-491b-933d-983c7db4da76 req-3733570d-2957-4615-a8f4-86546fdc48cc service nova] Creating event network-changed:7f3ec950-db3f-43e9-99f5-4a919a371957 for instance d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 on hv-cinder-85265 Aug 09 19:15:40.309348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-925ffbd5-67c8-491b-933d-983c7db4da76 req-3733570d-2957-4615-a8f4-86546fdc48cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065100 Aug 09 19:15:40.311346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 115/243] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:15:40.342967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:40.343580 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:40.354557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:40.355117 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:40.355569 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:40.356311 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:40.356867 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:40.357220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:40.794662 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:40.821213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5ce30e37-49dc-4258-9daa-68ffdc2337b0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.481977 Aug 09 19:15:40.834005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 129/244] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:40 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:40.883070 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:40.883840 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:40.897321 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:40.900731 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:40.902392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:40.903265 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:40.904859 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:40.905355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:40.937562 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:40.938304 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:40.953944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:40.956976 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:40.960356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:40.961886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:40.962895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:40.964197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:41.183340 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:41.197769 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c534ff9b-9222-4eb3-80b5-a07ad2613f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.323947 Aug 09 19:15:41.211889 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 116/245] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:40 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:41.374448 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:41.387886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-058b6697-ac44-45e2-b575-70bfbb75f02a tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.454655 Aug 09 19:15:41.388497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 130/246] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:40 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:41.856002 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:41.858045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:41.866854 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:41.867568 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:41.867995 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:41.869137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:41.869931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:41.870958 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:42.133371 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:42.155801 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-cfa57d64-a639-47b9-b842-849191b13f94 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.304481 Aug 09 19:15:42.160707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 117/247] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:41 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:42.227064 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:42.227691 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:42.237931 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:42.238428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:42.238855 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:42.245718 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:42.247973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:42.248525 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:42.408676 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:42.409278 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:42.416300 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:42.420731 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:42.421216 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:42.421939 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:42.422393 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:42.422808 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:42.707413 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:42.718257 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:42.734098 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-bfc4d23a-2846-4120-a3bc-3ac6c5fdc6a9 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.328206 Aug 09 19:15:42.751810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 118/248] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:42 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:42.765850 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-dc22c52a-a27c-42f3-be1d-b13ccf0df405 req-186e4777-154c-4fb5-aa53-166adfde255e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab83633d-a2ac-4257-b317-ed1894b0fd8d", "tag": "7542d5fc-836e-47fe-81ca-ad669ecb60de"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:42.791072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:42.803112 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3324b3e4-3fac-4103-b293-6091d4d3dfdb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.587005 Aug 09 19:15:42.812230 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 131/249] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:42 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:42.819223 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-dc22c52a-a27c-42f3-be1d-b13ccf0df405 req-186e4777-154c-4fb5-aa53-166adfde255e service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:42.819739 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-dc22c52a-a27c-42f3-be1d-b13ccf0df405 req-186e4777-154c-4fb5-aa53-166adfde255e service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:42.820140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-dc22c52a-a27c-42f3-be1d-b13ccf0df405 req-186e4777-154c-4fb5-aa53-166adfde255e service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:42.877341 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-dc22c52a-a27c-42f3-be1d-b13ccf0df405 req-186e4777-154c-4fb5-aa53-166adfde255e service nova] Creating event network-changed:7542d5fc-836e-47fe-81ca-ad669ecb60de for instance ab83633d-a2ac-4257-b317-ed1894b0fd8d on hv-cinder-85265 Aug 09 19:15:42.890673 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-dc22c52a-a27c-42f3-be1d-b13ccf0df405 req-186e4777-154c-4fb5-aa53-166adfde255e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134336 Aug 09 19:15:42.891290 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 119/250] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:15:43.185355 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:43.186186 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:43.197742 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:43.198473 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:43.199111 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:43.199833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:43.200292 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:43.200798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:43.596576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:43.617839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-95b34bcb-cc7b-49f5-8c78-83279d90fd96 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.434403 Aug 09 19:15:43.632822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 132/251] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:43 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:43.762842 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:43.764365 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:43.773553 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:43.775139 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:43.775982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:43.777586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:43.778276 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:43.778911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:43.828599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:43.829788 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:43.840405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:43.841239 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:43.842051 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:43.842999 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:43.843482 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:43.843917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:44.035498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:44.050393 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-38b4e136-aaa8-4c7c-81d7-b5f923ff8844 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.295657 Aug 09 19:15:44.051581 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 120/252] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:43 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:44.117442 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:44.127133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8f5d3b84-43ff-4b2f-902d-69e0d4e7be35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.303880 Aug 09 19:15:44.132958 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 133/253] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:43 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:44.643232 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:44.644529 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:44.655129 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:44.656523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:44.658348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:44.659948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:44.660810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:44.663457 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:44.907448 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:44.916686 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1d5ca645-c6dc-4a7f-b433-9d9b6cd17ee5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.279893 Aug 09 19:15:44.917585 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 121/254] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:44 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:45.072929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:45.075206 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:45.084317 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:45.085374 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:45.086970 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:45.088837 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:45.089495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:45.090166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:45.151205 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:45.151961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:45.162836 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:45.163331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:45.163953 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:45.164931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:45.165631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:45.166207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:45.379197 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:45.398496 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2230403f-b8df-48c6-a5cc-b436d9e2873b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.251662 Aug 09 19:15:45.401190 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 122/255] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:45 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:45.416136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:45.437268 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-7305719e-cd98-4139-8182-d4a2d776b68d tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.369734 Aug 09 19:15:45.443671 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 134/256] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:45 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:45.939040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:45.939736 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:45.941665 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:45.947448 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:45.947942 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:45.948368 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:45.949093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:45.949616 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:45.950036 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:46.120106 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:46.128666 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c3cb7feb-21f4-4efb-8685-5b4e5fe5fc20 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.193490 Aug 09 19:15:46.140668 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 123/257] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:45 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:46.422414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:46.423023 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:46.430297 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:46.430755 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:46.431185 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:46.431873 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:46.432320 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:46.432767 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:46.469860 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:46.471010 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:46.488530 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:46.489026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:46.490085 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:46.490845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:46.491351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:46.491768 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:46.605704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:46.617734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9229ca9c-6588-44ef-b9e4-c79852b560c8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.199057 Aug 09 19:15:46.628568 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 135/258] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:46 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:46.680315 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:46.687890 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8bbf0010-ab6a-423d-851d-a30c055e24ee tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.221889 Aug 09 19:15:46.688485 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 124/259] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:46 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:47.152304 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:47.153263 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:47.159148 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:47.159636 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:47.160072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:47.160846 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:47.161509 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:47.161976 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:47.173065 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-d1ab760b-c64b-4147-8931-54fce64174dc req-d8a7f792-f03c-411d-9ead-e67b5978feff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b61d3a-a4ec-45c1-a0d4-2a290704afe1", "name": "network-vif-plugged", "status": "completed", "tag": "7f3ec950-db3f-43e9-99f5-4a919a371957"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:47.188479 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d1ab760b-c64b-4147-8931-54fce64174dc req-d8a7f792-f03c-411d-9ead-e67b5978feff service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:47.189211 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d1ab760b-c64b-4147-8931-54fce64174dc req-d8a7f792-f03c-411d-9ead-e67b5978feff service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:47.190773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d1ab760b-c64b-4147-8931-54fce64174dc req-d8a7f792-f03c-411d-9ead-e67b5978feff service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:47.210647 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-d1ab760b-c64b-4147-8931-54fce64174dc req-d8a7f792-f03c-411d-9ead-e67b5978feff service nova] Creating event network-vif-plugged:7f3ec950-db3f-43e9-99f5-4a919a371957 for instance d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 on hv-cinder-85265 Aug 09 19:15:47.216348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-d1ab760b-c64b-4147-8931-54fce64174dc req-d8a7f792-f03c-411d-9ead-e67b5978feff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048649 Aug 09 19:15:47.217623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 125/260] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:15:47.244385 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:47.261203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=12 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:47.359869 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:47.379243 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-eb8ba50b-126c-4b21-8c32-2415c7a06a75 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.230973 Aug 09 19:15:47.381535 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 136/261] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:47 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:47.638029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=8 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:47.643052 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:47.643837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:47.658039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:47.658526 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:47.658958 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:47.659650 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:47.660101 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:47.660547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:47.715907 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:47.716547 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:47.724177 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:47.725535 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:47.725841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:47.726566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:47.727016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:47.727444 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:47.840371 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:47.849226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c07358fc-d9f4-4498-9526-af43dc1a1d62 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.211455 Aug 09 19:15:47.849807 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 126/262] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:47 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:47.906858 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:47.917344 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d3640cbc-30ba-484e-b610-bf0141ac8343 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.206167 Aug 09 19:15:47.917953 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 137/263] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:47 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:48.402794 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:48.403429 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:48.409563 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:48.410041 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:48.410493 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:48.411205 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:48.411681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:48.412156 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:48.547765 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:48.555740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-cce047a8-f3d8-4994-98c3-d14d222b05be tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.156985 Aug 09 19:15:48.556314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 127/264] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:48 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:48.872076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:48.872624 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:48.879152 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:48.879688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:48.880969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:48.881798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:48.882252 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:48.882681 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:48.940890 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:48.941499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:48.947980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:48.948480 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:48.949102 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:48.949787 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:48.950227 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:48.950748 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:49.023491 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:49.031283 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-eb81151c-0ed6-449e-83a0-688fa52e243b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.163112 Aug 09 19:15:49.031745 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 138/265] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:48 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:49.082246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:49.090111 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-601d7739-38a1-4783-878d-d6545fb597c0 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.153070 Aug 09 19:15:49.090690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 128/266] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:48 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:49.577241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:49.577857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:49.584763 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:49.585336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:49.585870 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:49.586574 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:49.587031 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:49.587460 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:49.721664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:49.729630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a29cf1ba-226a-4a7b-a3c6-e2f82e4aee3a tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.156274 Aug 09 19:15:49.730192 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 139/267] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:49 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:50.051882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:50.052513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:50.058546 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:50.059026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:50.059454 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:50.060136 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:50.060618 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:50.061036 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:50.111497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:50.112100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:50.118683 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:50.119157 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:50.119586 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:50.120271 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:50.120742 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:50.121165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:50.140211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=100 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:50.206633 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:50.214312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-bc85d63d-3ef7-422b-b837-83e4e542434e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.166732 Aug 09 19:15:50.215058 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 129/268] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:50 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:50.260780 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:50.268831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-97c03830-3ae8-41ce-9518-ad471a53fafb tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.161168 Aug 09 19:15:50.269395 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 140/269] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:50 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:50.751074 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:50.751685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:50.758679 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:50.759161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:50.759591 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:50.760279 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:50.760761 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:50.761212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:50.898534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:50.905992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-cb4d82eb-9dc9-4e0d-a163-bd77acfa1522 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.158872 Aug 09 19:15:50.906558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 130/270] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:50 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:51.237455 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:51.238060 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:51.245250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:51.245754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:51.246223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:51.247035 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:51.247545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:51.248013 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:51.290390 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:51.291705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:51.298232 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:51.299468 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:51.299913 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:51.300922 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:51.301411 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:51.302299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:51.411037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:51.432873 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-55b33fc8-1b14-497d-b6d1-d6d6e8e3df88 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.201896 Aug 09 19:15:51.433968 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 141/271] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:51 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:51.478671 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:51.486304 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8acb14a9-6579-4c96-93ce-696bfed38793 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.200758 Aug 09 19:15:51.486959 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 131/272] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:51 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:51.926727 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:51.927886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:51.930109 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:51.936892 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:51.937427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:51.937886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:51.938657 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:51.939176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:51.939598 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:52.080825 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:52.088304 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-631a1ed1-9149-439d-aafe-df3ee42af7bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.165731 Aug 09 19:15:52.088903 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 142/273] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:51 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:52.327508 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-061bde1a-8b60-4822-a677-c5edf0bffb07 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:52.328040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-061bde1a-8b60-4822-a677-c5edf0bffb07 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:52.334357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-061bde1a-8b60-4822-a677-c5edf0bffb07 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:52.334935 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-061bde1a-8b60-4822-a677-c5edf0bffb07 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:52.335367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-061bde1a-8b60-4822-a677-c5edf0bffb07 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:52.336052 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-061bde1a-8b60-4822-a677-c5edf0bffb07 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:52.336527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-061bde1a-8b60-4822-a677-c5edf0bffb07 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:52.336962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-061bde1a-8b60-4822-a677-c5edf0bffb07 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:52.361203 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-061bde1a-8b60-4822-a677-c5edf0bffb07 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/ips" status: 200 len: 151 microversion: 2.20 time: 0.037760 Aug 09 19:15:52.361780 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 132/274] 10.222.0.70 () {60 vars in 1289 bytes} [Tue Aug 9 19:15:52 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:15:52.455184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:52.455799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:52.462898 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:52.464703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:52.464703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:52.464703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:52.465109 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:52.465714 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:52.509137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:52.510450 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:52.518124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:52.519320 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:52.519929 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:52.521072 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:52.521853 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:52.522463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:52.669896 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:52.678818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c60ade09-1bb0-4f00-aa3e-a61d5da6a234 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.226836 Aug 09 19:15:52.680082 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 143/275] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:52 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:52.711860 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:52.721315 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-72d8867c-91e8-4158-b11c-8e5611e4555c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.217680 Aug 09 19:15:52.722117 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 133/276] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:52 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:53.109816 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:53.110365 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:53.117144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:53.117634 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:53.118061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:53.118748 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:53.119199 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:53.119623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:53.252935 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:53.260994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-aa5d3007-8aa7-410c-b9e3-0d15ff2fecc7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.155145 Aug 09 19:15:53.261561 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 144/277] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:53 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:53.700303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:53.700947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:53.706804 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:53.707435 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:53.707875 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:53.708622 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:53.709127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:53.709538 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:53.743696 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:53.744299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:53.750956 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:53.751424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:53.751850 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:53.752567 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:53.753015 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:53.753428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:53.843005 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:53.851414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f3a7f976-6941-43b6-840d-279117374672 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.154833 Aug 09 19:15:53.852004 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 134/278] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:53 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:53.892234 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:53.900552 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5120dfb8-c2e3-4705-a3ce-e555cd8cef5c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1314 microversion: 2.1 time: 0.161164 Aug 09 19:15:53.901120 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 145/279] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:53 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:54.266174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-6425b7e6-cb31-4926-920a-fdbf84827916 req-1abec2c5-6c03-411d-b551-d07da5efe2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab83633d-a2ac-4257-b317-ed1894b0fd8d", "name": "network-vif-plugged", "status": "completed", "tag": "7542d5fc-836e-47fe-81ca-ad669ecb60de"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:54.277282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-6425b7e6-cb31-4926-920a-fdbf84827916 req-1abec2c5-6c03-411d-b551-d07da5efe2bc service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:54.278180 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-6425b7e6-cb31-4926-920a-fdbf84827916 req-1abec2c5-6c03-411d-b551-d07da5efe2bc service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:54.279054 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-6425b7e6-cb31-4926-920a-fdbf84827916 req-1abec2c5-6c03-411d-b551-d07da5efe2bc service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:54.281577 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:54.282215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:54.290969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:54.290969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:54.290969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:54.291313 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:54.291587 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:54.292008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:54.311915 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-6425b7e6-cb31-4926-920a-fdbf84827916 req-1abec2c5-6c03-411d-b551-d07da5efe2bc service nova] Creating event network-vif-plugged:7542d5fc-836e-47fe-81ca-ad669ecb60de for instance ab83633d-a2ac-4257-b317-ed1894b0fd8d on hv-cinder-85265 Aug 09 19:15:54.325974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-6425b7e6-cb31-4926-920a-fdbf84827916 req-1abec2c5-6c03-411d-b551-d07da5efe2bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063318 Aug 09 19:15:54.327216 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 135/280] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:15:54.467740 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:54.477316 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b8791a88-1898-4305-94b4-76c2ccdb25a5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.199473 Aug 09 19:15:54.477932 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 146/281] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:54 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:54.873054 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:54.873792 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:54.880931 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:54.881416 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:54.881836 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:54.882517 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:54.882992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:54.883404 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:54.921116 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:54.922221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:54.930293 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:54.930779 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:54.931212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:54.931906 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:54.932357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:54.933082 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:55.046603 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:55.054637 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-83c2de3a-4f01-41e9-a842-6aa5845e1ffc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.186033 Aug 09 19:15:55.055211 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 136/282] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:54 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:55.069037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:55.076805 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5c0d1d4e-5753-43f5-9f31-e82eb6673096 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1498 microversion: 2.1 time: 0.159456 Aug 09 19:15:55.077372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 147/283] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:54 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:55.501683 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:55.502277 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:55.508903 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:55.509372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:55.509849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:55.510519 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:55.510980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:55.511395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:55.645102 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:55.648853 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:15:55.653733 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-df5b8db7-ef5a-4de0-bbf7-812defc4ff5e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.155905 Aug 09 19:15:55.654305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 137/284] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:55 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:56.075643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:56.076246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:56.082576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:56.083052 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:56.083477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:56.084156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:56.085184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:56.085610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:56.219247 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:56.226829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-649c18af-6fe9-4120-a0b8-ece856f9abd7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.154956 Aug 09 19:15:56.227396 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 148/285] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:56 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:56.674972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:56.675584 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:56.681804 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:56.682292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:56.682727 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:56.683413 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:56.683865 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:56.684311 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:56.817686 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:56.825854 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d5804202-d4e6-455b-98c4-a4c9707ac19d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.155004 Aug 09 19:15:56.826615 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 138/286] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:56 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:57.250929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:57.251539 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:57.258893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:57.259371 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:57.259800 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:57.260523 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:57.260974 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:57.261392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:57.430334 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:57.437733 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a6e2ff06-b7c5-4de1-8405-edb728ec48a7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.190643 Aug 09 19:15:57.438305 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 149/287] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:57 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:57.846941 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:57.847585 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:57.855226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:57.855783 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:57.856280 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:57.857066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:57.857576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:57.858087 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.003286 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:58.011712 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-96c16ee8-718c-4e9b-9648-e76c39a9605f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.168499 Aug 09 19:15:58.012303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 139/288] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:57 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:58.017726 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:58.018698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:58.025033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.025529 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.025965 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.026657 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.027365 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.027706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.058674 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:15:58.192264 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-748d8abc-bf71-407e-bd9b-3b883322256b tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 204 len: 0 microversion: 2.1 time: 0.177567 Aug 09 19:15:58.194113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 150/289] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:15:58 2022] DELETE /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:15:58.203082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:58.204135 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:58.211496 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.212194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.212818 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.213964 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.214522 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.215014 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.352915 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:58.361211 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-aec1e1b6-28fc-4704-ac65-d47007007de3 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1504 microversion: 2.1 time: 0.162385 Aug 09 19:15:58.361843 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 140/290] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:58 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:58.466136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:58.466837 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:58.473305 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.473789 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.474223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.474984 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.475802 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.476227 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.614436 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:58.622788 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-08162ae0-96e5-4260-a3e1-63a26e853200 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.160898 Aug 09 19:15:58.623361 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 151/291] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:58 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:58.743936 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:15:58.744486 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:58.750545 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.751018 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.751445 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.752120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.752606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.753026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.775909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lazy-loading 'flavor' on Instance uuid b5249124-ef8d-4931-8114-ad85549b447c {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:15:58.980276 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0150379d-841c-4be8-be82-3475146c0d47 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/action" status: 202 len: 0 microversion: 2.20 time: 0.240154 Aug 09 19:15:58.981048 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 141/292] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Aug 9 19:15:58 2022] POST /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:15:58.989268 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:58.989880 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:58.997367 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.997935 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.998372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:58.999061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:58.999515 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:58.999939 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:59.035187 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:59.035884 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:59.043280 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:59.043770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:59.044210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:59.044926 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:59.045376 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:59.045797 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:59.141949 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:59.151719 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:59.153577 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:59.154870 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-28fca52d-f38f-47f5-8056-4b6f5ff803a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.169479 Aug 09 19:15:59.155578 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 152/293] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:15:58 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:15:59.323474 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:59.331087 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-fbba35d3-dd65-413c-88fe-335efffc130c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.300004 Aug 09 19:15:59.331598 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 142/294] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:59 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:15:59.383184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:59.383981 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:59.390899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:59.390899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:59.391224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:59.391929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:59.392382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:59.392831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:59.524979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:59.532457 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-426b6fbe-9bb5-48f0-a99c-fed18c8ab621 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1504 microversion: 2.1 time: 0.154163 Aug 09 19:15:59.533021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 153/295] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:59 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:15:59.644432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:15:59.644976 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:15:59.651480 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:59.651949 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:59.652371 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:59.653246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:15:59.653684 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:15:59.654097 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:15:59.781919 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:15:59.789615 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a2be4a08-638b-4620-b974-93c819e64ddf tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.149068 Aug 09 19:15:59.790180 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 143/296] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:15:59 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:00.181565 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:00.182105 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:00.188812 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:00.189297 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:00.189740 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:00.190428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:00.190886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:00.191313 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:00.323064 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:00.330971 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:00.332516 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:00.333679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f058e3c3-c9be-4c83-a5f3-135950684d45 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.156597 Aug 09 19:16:00.334257 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 154/297] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:00 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:00.352733 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:00.353337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:00.359220 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:00.359699 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:00.360140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:00.360844 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:00.361293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:00.361711 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:00.489679 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:00.498188 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f951ed35-6c3f-4c9d-be0b-724c27ae5bec tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.150038 Aug 09 19:16:00.498765 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 144/298] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:00 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:00.554987 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:00.555631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:00.561830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:00.562307 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:00.562736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:00.563419 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:00.563872 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:00.564292 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:00.581960 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:00.692929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:00.700347 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bd34f671-d7d7-4f23-a4c2-b3d342faef69 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1504 microversion: 2.1 time: 0.149858 Aug 09 19:16:00.700936 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 155/299] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:00 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:00.810781 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:00.811383 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:00.813428 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:00.819054 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:00.819662 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:00.820094 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:00.821256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:00.821709 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:00.822131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:00.961431 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:00.968804 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3c566406-7d76-45d1-a9b0-18655251a561 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.161904 Aug 09 19:16:00.969369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 145/300] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:00 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:01.356608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:01.357295 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:01.364041 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:01.364590 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:01.365108 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:01.366087 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:01.366577 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:01.367004 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:01.519156 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:01.519764 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:01.526598 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:01.527088 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:01.527513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:01.528201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:01.529284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:01.529989 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:01.542917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:01.552350 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:01.554398 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:01.555831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ae494353-7a68-4094-8bd1-b3613de0b69a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.203145 Aug 09 19:16:01.556743 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 156/301] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:01 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:01.672629 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:01.680239 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-30bd89bc-8511-4a88-9c6c-2c1368b6df7c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.164954 Aug 09 19:16:01.680825 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 146/302] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:01 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:16:01.723016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:01.723623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:01.729843 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:01.730321 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:01.730758 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:01.731443 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:01.731894 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:01.732315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:01.864130 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:01.873219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-de9b7502-513a-48af-b564-a86bc7c5fd72 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1504 microversion: 2.1 time: 0.153888 Aug 09 19:16:01.874394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 157/303] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:01 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:01.990391 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:01.991537 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:01.997563 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:01.998153 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:01.998543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:01.999237 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:01.999685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:02.000106 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:02.148163 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:02.155683 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-abe79f7f-4a2f-40f1-a82d-cbc1e4625a35 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.169751 Aug 09 19:16:02.156558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 147/304] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:01 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:02.588688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:02.588688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:02.597814 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:02.598426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:02.599718 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:02.600529 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:02.601050 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:02.601918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:02.702719 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:02.705030 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:02.714163 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:02.714886 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:02.715922 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:02.717122 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:02.717871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:02.718452 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:02.802348 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:02.812430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:02.814036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:02.815196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bb46e582-9a27-4420-add1-9ea29a532158 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.239844 Aug 09 19:16:02.815743 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 158/305] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:02 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:02.892113 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:02.895524 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:02.896383 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:02.901088 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b14393ff-0547-494e-bd53-23a4951edd44 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.203521 Aug 09 19:16:02.901663 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 148/306] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:02 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:16:02.903254 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:02.903936 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:02.904431 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:02.905312 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:02.905839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:02.906318 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:03.178124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:03.179463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:03.185541 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:03.186399 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:03.186917 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:03.187518 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:03.187974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:03.188419 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:03.217836 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:03.225816 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0f9979db-4d6e-44ec-9c63-c2ce5c61e24c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1504 microversion: 2.1 time: 0.334505 Aug 09 19:16:03.226390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 159/307] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:02 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1504 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:16:03.326104 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:03.333580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-27e8c83c-1aa8-4279-814d-aef5de7b9166 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1362 microversion: 2.1 time: 0.159265 Aug 09 19:16:03.334141 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 149/308] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:03 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:16:03.842942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:03.843704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:03.855290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:03.857586 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:03.858397 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:03.859339 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:03.859481 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:03.861404 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:03.931491 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:03.933280 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:03.940810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:03.941461 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:03.942098 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:03.942986 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:03.943608 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:03.944048 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:04.083760 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:04.094043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7a43a573-9930-44a3-bf74-473646f32ece tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.175684 Aug 09 19:16:04.094706 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 150/309] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:03 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:04.115459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:04.126360 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:04.126568 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:04.127768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-acbc0c6b-1831-4369-bd76-11f26fa4eb50 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.289125 Aug 09 19:16:04.143351 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 160/310] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:03 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:04.248702 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:04.248702 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:04.264664 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:04.265454 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:04.266231 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:04.267327 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:04.268118 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:04.268899 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:04.356035 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:04.356778 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:04.365289 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:04.366824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:04.367515 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:04.372606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:04.373243 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:04.373694 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:04.403594 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:04.417785 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-63e5fe56-5cd9-40a8-82c8-2c58dfc2ecf5 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1462 microversion: 2.1 time: 0.174068 Aug 09 19:16:04.418848 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 151/311] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:04 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1462 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:04.424565 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-3e00c52b-0339-46b9-8392-ed217d5773d9 req-c165ace8-077d-4686-982d-6aa8e7fa4f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b61d3a-a4ec-45c1-a0d4-2a290704afe1", "name": "network-vif-deleted", "tag": "7f3ec950-db3f-43e9-99f5-4a919a371957"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:04.437080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-3e00c52b-0339-46b9-8392-ed217d5773d9 req-c165ace8-077d-4686-982d-6aa8e7fa4f4d service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:04.438068 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-3e00c52b-0339-46b9-8392-ed217d5773d9 req-c165ace8-077d-4686-982d-6aa8e7fa4f4d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:04.439395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-3e00c52b-0339-46b9-8392-ed217d5773d9 req-c165ace8-077d-4686-982d-6aa8e7fa4f4d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:04.451981 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-3e00c52b-0339-46b9-8392-ed217d5773d9 req-c165ace8-077d-4686-982d-6aa8e7fa4f4d service nova] Creating event network-vif-deleted:7f3ec950-db3f-43e9-99f5-4a919a371957 for instance d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 on hv-cinder-85265 Aug 09 19:16:04.457097 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-3e00c52b-0339-46b9-8392-ed217d5773d9 req-c165ace8-077d-4686-982d-6aa8e7fa4f4d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036965 Aug 09 19:16:04.457758 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 152/312] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:04.543674 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:04.551984 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-67c6870b-f96c-4ef7-8328-6f2dd77cba44 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1548 microversion: 2.1 time: 0.200250 Aug 09 19:16:04.552571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 161/313] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:04 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:04.574691 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1007eecb-7cb4-40da-a904-300caa2cb6e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:04.575377 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1007eecb-7cb4-40da-a904-300caa2cb6e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:04.584837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1007eecb-7cb4-40da-a904-300caa2cb6e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:04.585317 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1007eecb-7cb4-40da-a904-300caa2cb6e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:04.585923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1007eecb-7cb4-40da-a904-300caa2cb6e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:04.586649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1007eecb-7cb4-40da-a904-300caa2cb6e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:04.587090 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1007eecb-7cb4-40da-a904-300caa2cb6e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:04.587505 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1007eecb-7cb4-40da-a904-300caa2cb6e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:04.592353 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:04.690335 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1007eecb-7cb4-40da-a904-300caa2cb6e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120184 Aug 09 19:16:04.690936 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 153/314] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Aug 9 19:16:04 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:05.116638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:05.117462 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:05.124543 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:05.125036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:05.125643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:05.126349 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:05.126802 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:05.127222 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:05.152168 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:05.153188 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:05.159779 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:05.160384 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:05.160913 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:05.161684 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:05.162304 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:05.163568 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:05.308321 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:05.318810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:05.321573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:05.322796 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-17118001-f74d-4821-b26b-b95fe15714c3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.175546 Aug 09 19:16:05.323359 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 154/315] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:05 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:05.404047 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:05.412005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c6bb9799-246d-4adf-a985-06367474519c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.300248 Aug 09 19:16:05.413114 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 162/316] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:05 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:05.440597 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:05.441225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:05.448375 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:05.448930 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:05.449363 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:05.450061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:05.450504 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:05.450922 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:05.491143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:05.491143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:05.491143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:05.491143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lazy-loading 'fault' on Instance uuid d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:16:05.544838 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eef1ea8d331444e892d0b30c1feef904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b2b1481db4b878ceee550360da8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:05.555003 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7e94b940-159c-4456-b89d-7b912186f7a6 tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 200 len: 1304 microversion: 2.1 time: 0.118231 Aug 09 19:16:05.555855 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 155/317] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:05 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:06.348173 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:06.349390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:06.357384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.358134 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.358565 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.359457 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.360090 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.360539 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.421468 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6b6ba53b-badf-4102-8cbd-5dc1e83806e2 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5f7dc69-568d-4d41-b1f7-909c65b79044", "device": "/dev/sdb"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:06.424945 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6b6ba53b-badf-4102-8cbd-5dc1e83806e2 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:06.433717 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b6ba53b-badf-4102-8cbd-5dc1e83806e2 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.434202 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b6ba53b-badf-4102-8cbd-5dc1e83806e2 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.434628 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b6ba53b-badf-4102-8cbd-5dc1e83806e2 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.435314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b6ba53b-badf-4102-8cbd-5dc1e83806e2 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.435761 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b6ba53b-badf-4102-8cbd-5dc1e83806e2 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.436177 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b6ba53b-badf-4102-8cbd-5dc1e83806e2 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.572904 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:06.583174 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:06.595402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:06.596905 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e1263718-25a6-4e4d-aa52-1efa287e5225 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.253447 Aug 09 19:16:06.597499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 163/318] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:06 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:06.621722 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:06.623638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:06.629800 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.630488 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.631075 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.631857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.632309 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.632913 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.824255 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6b6ba53b-badf-4102-8cbd-5dc1e83806e2 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "POST /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408120 Aug 09 19:16:06.830215 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 156/319] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:16:06 2022] POST /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9/os-volume_attachments => generated 194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:16:06.832778 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-4c032e12-32dc-494f-9c3c-b1de3498ce8c req-a2e0509c-56cf-4d15-86b6-ca5399f5a8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab83633d-a2ac-4257-b317-ed1894b0fd8d", "tag": "7542d5fc-836e-47fe-81ca-ad669ecb60de"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:06.848710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4c032e12-32dc-494f-9c3c-b1de3498ce8c req-a2e0509c-56cf-4d15-86b6-ca5399f5a8fb service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.849196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4c032e12-32dc-494f-9c3c-b1de3498ce8c req-a2e0509c-56cf-4d15-86b6-ca5399f5a8fb service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.849824 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4c032e12-32dc-494f-9c3c-b1de3498ce8c req-a2e0509c-56cf-4d15-86b6-ca5399f5a8fb service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.862890 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-4c032e12-32dc-494f-9c3c-b1de3498ce8c req-a2e0509c-56cf-4d15-86b6-ca5399f5a8fb service nova] Creating event network-changed:7542d5fc-836e-47fe-81ca-ad669ecb60de for instance ab83633d-a2ac-4257-b317-ed1894b0fd8d on hv-cinder-85265 Aug 09 19:16:06.875596 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-4c032e12-32dc-494f-9c3c-b1de3498ce8c req-a2e0509c-56cf-4d15-86b6-ca5399f5a8fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043308 Aug 09 19:16:06.876467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:06.876671 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 157/320] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:06.891834 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3b213fdc-7f1c-4f3d-9445-f5f175c6a240 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1502 microversion: 2.1 time: 0.272356 Aug 09 19:16:06.896317 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 164/321] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:06 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:06.897091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:06.898544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] [instance: d6b61d3a-a4ec-45c1-a0d4-2a290704afe1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:06.915584 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.917397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.918046 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.918945 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.919326 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "988912c7-699d-45e0-ae1a-f724cf63f08b"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:06.920060 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.920679 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.922033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:06.933665 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.934700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.935314 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.936365 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:06.936999 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:06.937622 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:06.940275 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] HTTP exception thrown: Instance d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 could not be found. Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Request method failure captured: Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 HTTP/1.1 Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rI4ZVHpP7UEdoWNCzrwgRj0gRjG3p57rXq_oMmIwKQXcBspaBazRRdajqeVQCr7VwRi7VB9n1ejJWUkI08p9lsiWevGDgJ59_JWCUz1KE0fF_hgBaktvfLgq4xibLFep4Qp5vk9C1swJIQADXez0WPr9kJ1PtP0qc6nU8fXTQrdZrY Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: d11b2b1481db4b878ceee550360da8fe Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-VolumesActionsTest-1816687812 Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:16:06.942297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d11b2b1481db4b878ceee550360da8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d11b2b1481db4b878ceee550360da8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d11b2b1481db4b878ceee550360da8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d11b2b1481db4b878ceee550360da8fe"}]}] Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-VolumesActionsTest-1816687812 Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: d11b2b1481db4b878ceee550360da8fe Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-VolumesActionsTest-1816687812 Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-VolumesActionsTest-1816687812-project Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: eef1ea8d331444e892d0b30c1feef904 Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-VolumesActionsTest-1816687812-project Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 could not be found. Aug 09 19:16:06.943864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'd6b61d3a-a4ec-45c1-a0d4-2a290704afe1'} Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 could not be found. Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:16:06.945749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 could not be found. Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 could not be found. Aug 09 19:16:06.947312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.949909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] Returning 404 to user: Instance d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:16:06.951457 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d0ffad85-db10-4941-a337-38b86227bb6c tempest-VolumesActionsTest-1816687812 tempest-VolumesActionsTest-1816687812-project] 10.222.0.70 "GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1" status: 404 len: 111 microversion: 2.1 time: 0.073597 Aug 09 19:16:06.953059 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 158/322] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:06 2022] GET /compute/v2.1/servers/d6b61d3a-a4ec-45c1-a0d4-2a290704afe1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] HTTP exception thrown: Cannot 'attach_volume' instance 5a736d74-42d3-4b24-b251-f869fbbefdaf while it is in vm_state rescued Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Request method failure captured: Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: POST /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf/os-volume_attachments HTTP/1.1 Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 74 Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH3PlQVzEuZp387bTiBC5IV-2rAoCHSptdv8F5GdriAd-02z-mfqZPuvHtdE3J4PjFbt0AGaEoD4LVGFS_Qgy6Iw96aRVYRM8ZYFuZMcbO5eFGETiY1bW3sfSo5A0XbvTlEf8vqy83vaYVpRZa_x5dExriEkiuGg0GLTcK7ZnCXYfs Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:16:06.985356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/375ce88986dc47b08134e076562eee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_375ce88986dc47b08134e076562eee05"}]}] Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 8755b16a18734175b691f891351d5116 Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {"volumeAttachment": {"volumeId": "988912c7-699d-45e0-ae1a-f724cf63f08b"}} Aug 09 19:16:06.987210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Cannot 'attach_volume' instance 5a736d74-42d3-4b24-b251-f869fbbefdaf while it is in vm_state rescued Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'server_id': '5a736d74-42d3-4b24-b251-f869fbbefdaf', 'body': {'volumeAttachment': {'volumeId': '988912c7-699d-45e0-ae1a-f724cf63f08b'}}} Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5a736d74-42d3-4b24-b251-f869fbbefdaf in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:16:06.988080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5a736d74-42d3-4b24-b251-f869fbbefdaf while it is in vm_state rescued Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:16:06.989427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:16:06.991076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:16:06.991076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:16:06.991076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5a736d74-42d3-4b24-b251-f869fbbefdaf while it is in vm_state rescued Aug 09 19:16:06.991076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:16:06.991076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Returning 409 to user: Cannot 'attach_volume' instance 5a736d74-42d3-4b24-b251-f869fbbefdaf while it is in vm_state rescued {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:16:06.991076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b4a9bfb2-baff-48c5-b10a-db082032bd5f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067009 Aug 09 19:16:06.991076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 165/323] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:16:06 2022] POST /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 19:16:07.007148 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f240b63e-e1d2-4fb7-a763-bda860b042c5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:07.008834 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f240b63e-e1d2-4fb7-a763-bda860b042c5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:07.018124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f240b63e-e1d2-4fb7-a763-bda860b042c5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:07.018792 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f240b63e-e1d2-4fb7-a763-bda860b042c5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:07.019382 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f240b63e-e1d2-4fb7-a763-bda860b042c5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:07.020161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f240b63e-e1d2-4fb7-a763-bda860b042c5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:07.020957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f240b63e-e1d2-4fb7-a763-bda860b042c5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:07.021814 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f240b63e-e1d2-4fb7-a763-bda860b042c5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:07.130613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f240b63e-e1d2-4fb7-a763-bda860b042c5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf/action" status: 202 len: 0 microversion: 2.1 time: 0.130752 Aug 09 19:16:07.132860 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 159/324] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:16:06 2022] POST /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:16:07.141650 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:07.142252 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:07.149710 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:07.150583 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:07.151380 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:07.152284 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:07.152931 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:07.153670 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:07.624989 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:07.626233 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:07.633625 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:07.634513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:07.635110 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:07.636403 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:07.637034 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:07.638731 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:07.675649 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:07.688178 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-144d025f-ba4c-4a92-8ac5-ee319c914e68 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1510 microversion: 2.1 time: 0.550737 Aug 09 19:16:07.691116 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 166/325] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:07 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1510 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:08.093943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:08.105311 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:08.112747 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:08.112747 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-bca0b9a7-b503-4790-b591-f79d2c4ba2ae tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.488965 Aug 09 19:16:08.123052 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 160/326] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:07 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:08.717399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:08.718388 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:08.725924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:08.726720 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:08.727651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:08.728599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:08.729593 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:08.730136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:08.971298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:08.981290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b5acb7db-1229-4f86-bed3-2cb97b1ad72f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1510 microversion: 2.1 time: 0.268271 Aug 09 19:16:08.982525 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 167/327] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:08 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1510 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:09.132365 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:09.133320 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:09.140344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:09.141115 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:09.141754 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:09.142459 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:09.142907 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:09.143353 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:09.282649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:09.291402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:09.292500 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:09.293654 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f30d313d-37c6-4673-80da-60e91f1a8398 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.166416 Aug 09 19:16:09.294206 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 161/328] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:09 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:10.002991 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:10.003602 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:10.010094 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:10.010566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:10.010993 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:10.011671 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:10.012121 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:10.012570 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:10.142251 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:10.150647 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-196e1053-5f54-4580-857c-271fd7778bc8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1510 microversion: 2.1 time: 0.151468 Aug 09 19:16:10.151209 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 168/329] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:09 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:10.316480 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:10.317098 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:10.324340 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:10.324852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:10.325288 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:10.325979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:10.326429 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:10.326852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:10.462540 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:10.470773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:10.472304 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:10.473505 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-22df6207-4a0a-4f41-8295-c000a0dc4267 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.161011 Aug 09 19:16:10.474059 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 162/330] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:10 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:11.172271 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:11.173006 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:11.180834 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:11.181315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:11.181744 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:11.182454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:11.182899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:11.183641 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:11.322016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:11.329433 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fa4099d7-7bb8-4033-9c23-0fca1a828186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1510 microversion: 2.1 time: 0.161225 Aug 09 19:16:11.329993 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 169/331] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:11 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:11.496133 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:11.496751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:11.503213 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:11.503687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:11.504109 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:11.504827 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:11.505268 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:11.505681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:11.641294 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:11.650109 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:11.651619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:11.652789 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3e0c855e-7300-4ed2-ab1c-fc356246ce3e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.160513 Aug 09 19:16:11.653342 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 163/332] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:11 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:12.351157 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:12.351860 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:12.358897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:12.359430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:12.359983 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:12.360737 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:12.361239 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:12.361728 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:12.551155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:12.559722 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d70cc919-2c5d-4428-8b8d-684e3f3f4f14 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1510 microversion: 2.1 time: 0.212783 Aug 09 19:16:12.572875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 170/333] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:12 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:12.675587 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:12.676809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:12.684333 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:12.684887 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:12.685325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:12.686022 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:12.686777 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:12.687205 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:12.863322 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:12.872637 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:12.874410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:12.875565 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c63f7e02-b064-420e-bfb6-c221281a3249 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.204194 Aug 09 19:16:12.876122 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 164/334] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:12 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:13.582633 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:13.583242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:13.590596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:13.591072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:13.592284 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:13.593418 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:13.594065 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:13.594492 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:13.776593 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:13.787490 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ce192d68-8c9e-45ea-afab-0d93dc2675a8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1510 microversion: 2.1 time: 0.208681 Aug 09 19:16:13.788417 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 171/335] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:13 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:13.900625 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:13.901443 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:13.908236 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:13.908827 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:13.909367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:13.910141 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:13.910663 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:13.911322 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:14.134315 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:14.144242 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:14.146316 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:14.148689 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2acc6a19-be97-4a51-8b66-ae48b069bad4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.252274 Aug 09 19:16:14.149638 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 165/336] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:13 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:14.820983 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:14.821688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:14.832707 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:14.833162 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:14.835503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:14.836246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:14.837946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:14.838567 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:14.869415 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=100 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:15.183045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:15.184517 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:15.192306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:15.192972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:15.193672 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:15.194557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:15.195333 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:15.195892 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:15.199003 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:15.215530 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-60b88982-0c7e-443d-b445-59d3d14b6865 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1516 microversion: 2.1 time: 0.401953 Aug 09 19:16:15.216687 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 172/337] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:14 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1516 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:15.424007 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:15.437003 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:15.439666 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:15.442184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1dca8e22-5987-4ec9-a124-6c560121a9e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.263833 Aug 09 19:16:15.444369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 166/338] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:15 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:16.469861 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:16.470557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:16.479471 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:16.479964 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:16.480395 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:16.481130 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:16.482187 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:16.486374 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:16.673405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:16.683079 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:16.685026 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:16.686494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ca24adb2-f770-46b1-b55a-88638997b778 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.220524 Aug 09 19:16:16.687307 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 173/339] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:16 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:16.837939 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8ae56fdd-ec50-490d-bc93-dada6cdb64a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'create', calling method: .version_select at 0x7fa508519820>, body: {"keypair": {"name": "tempest-keypair-1458459783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxba+oVh+S2tU0PVfqQarRoe6ttMLRvmMUWIh2Uiz+HW4dWenyGDNdd1h1+sN7h3W3Wa6Xi3vIcq8UM/q/1JAvVeCq3e23nz+ER7dDZHdt4JYmSbgjrjFVTvnRWV1RP9A=="}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:16.869753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-8ae56fdd-ec50-490d-bc93-dada6cdb64a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Getting quotas for project 375ce88986dc47b08134e076562eee05. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:16:16.875439 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-8ae56fdd-ec50-490d-bc93-dada6cdb64a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Getting quotas for user 8755b16a18734175b691f891351d5116 and project 375ce88986dc47b08134e076562eee05. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:16:16.907558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8ae56fdd-ec50-490d-bc93-dada6cdb64a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074713 Aug 09 19:16:16.908354 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 167/340] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:16:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:17.713775 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:17.714590 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:17.723440 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:17.724457 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:17.725208 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:17.726185 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:17.726854 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:17.727477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:18.016119 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:18.026152 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:18.027872 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:18.035133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a5d25742-0c8f-4b1c-8c38-7c6e37f3e1f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.323734 Aug 09 19:16:18.054928 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 174/341] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:17 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:19.069302 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:19.071923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:19.104945 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:19.107182 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:19.110075 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:19.115092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:19.116849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:19.119451 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:19.271300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-110146963", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84108d42-a333-4e3d-88e7-e08ac356df37"}], "security_groups": [{"name": "tempest-securitygroup--144639287"}], "key_name": "tempest-keypair-1458459783", "user_data": "}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:19.496874 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:19.512831 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:19.515863 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:19.517910 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3ed0d4fe-ffae-4c70-8824-608ba4b6f049 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.457696 Aug 09 19:16:19.519062 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 168/342] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:19 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:20.543596 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:20.544392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:20.551544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:20.552036 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:20.552484 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:20.554137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:20.554592 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:20.555175 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:20.719936 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:20.723207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:20.738928 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:20.740358 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:20.742624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-12b7896a-7a1e-4ad0-a0b4-3b294bd268a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.203485 Aug 09 19:16:20.756713 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 169/343] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:20 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:21.770058 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:21.770747 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:21.778866 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:21.779345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:21.779774 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:21.780475 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:21.780925 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:21.781347 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:21.916149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:21.924335 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:21.925869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:21.927008 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1b8547be-7b65-49be-a296-eb56f6f054d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.160875 Aug 09 19:16:21.927573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 170/344] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:21 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:22.950161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:22.950774 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:22.957173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:22.957641 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:22.958073 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:22.958746 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:22.959210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:22.959622 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:23.095776 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:23.103651 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:23.105182 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:23.106329 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8432d4a1-ce51-4f6d-8230-0988007025d1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.160145 Aug 09 19:16:23.106883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 171/345] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:22 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:24.129824 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:24.130478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:24.138437 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:24.139013 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:24.140536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:24.141667 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:24.142419 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:24.143370 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:24.294845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:24.305081 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:24.307149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:24.308690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3bc92c3a-5787-4e9c-9e08-bea0e0f61786 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1742 microversion: 2.20 time: 0.183168 Aug 09 19:16:24.309500 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 172/346] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:24 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:25.341760 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:25.341760 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:25.358681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:25.359242 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:25.359760 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:25.360581 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:25.361148 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:25.361580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:25.519098 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:25.528365 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:25.529928 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:25.531092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a40ab9b9-cdf1-46fd-b53e-7a74dbea51fc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1742 microversion: 2.20 time: 0.198400 Aug 09 19:16:25.531801 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 173/347] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:25 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1742 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:26.559351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:26.560812 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:26.583862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:26.584779 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:26.585311 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:26.586250 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:26.586899 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:26.587516 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:26.730332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:26.740022 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:26.742299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:26.743681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f7c5748f-aad8-4151-8015-9d0f11043ad5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1742 microversion: 2.20 time: 0.188149 Aug 09 19:16:26.744153 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 174/348] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:26 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1742 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:27.771056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:27.773696 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:27.780129 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=4 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:27.783692 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:27.784554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:27.785014 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:27.785911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:27.786544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:27.786974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:27.959126 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:27.968713 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:27.971438 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:27.973184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-23819514-b337-4cdf-86de-32360659c831 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1742 microversion: 2.20 time: 0.206707 Aug 09 19:16:27.975344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 175/349] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:27 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1742 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:28.020310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=14 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:28.109648 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] validate_networks() for [('84108d42-a333-4e3d-88e7-e08ac356df37', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:16:28.348388 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:28.572686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:16:28.573107 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:16:28.573463 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:16:28.573862 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:16:28.574264 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:16:28.583045 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:28.583523 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:28.584152 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:28.584743 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:28.585192 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:28.585608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:28.602969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Getting quotas for project 375ce88986dc47b08134e076562eee05. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:16:28.608731 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Getting quotas for user 8755b16a18734175b691f891351d5116 and project 375ce88986dc47b08134e076562eee05. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:16:28.622621 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:16:28.624886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:16:28.670616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0b13b0d9-7261-4e11-b2f4-5718dcfe585f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.410582 Aug 09 19:16:28.674824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 175/350] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:16:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 9413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:16:28.683119 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f4be6d3d-059a-4954-82ab-b16f58ccbc0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:28.683745 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f4be6d3d-059a-4954-82ab-b16f58ccbc0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:28.737885 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f4be6d3d-059a-4954-82ab-b16f58ccbc0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:28.745223 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f4be6d3d-059a-4954-82ab-b16f58ccbc0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1245 microversion: 2.1 time: 0.066299 Aug 09 19:16:28.745793 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 176/351] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:28 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:29.001640 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:29.015114 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:29.045516 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:29.052006 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:29.054728 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:29.055966 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:29.056671 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:29.057443 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:29.270963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:29.281186 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:29.282708 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:29.283902 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-291b4a49-e9c8-4223-b431-5800319834d4 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1742 microversion: 2.20 time: 0.286196 Aug 09 19:16:29.284476 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 176/352] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:28 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1742 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:29.767183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:29.768085 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:29.775579 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:29.776161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:29.776713 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:29.777406 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:29.778044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:29.778464 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:29.865171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:29.875465 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-40e55885-e666-4ac0-a130-f80857ed7667 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1297 microversion: 2.1 time: 0.112309 Aug 09 19:16:29.876350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 177/353] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:29 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1297 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:30.322181 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:30.322793 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:30.329234 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:30.329717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:30.330155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:30.330844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:30.331298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:30.331751 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:30.462425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:30.470414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:30.471938 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:30.473213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8b8ae1c6-1e6b-4ee6-8807-d7a8aab8d39e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.155640 Aug 09 19:16:30.473769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 177/354] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:30 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:30.901551 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:30.902186 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:30.904463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:30.909876 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:30.910360 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:30.910793 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:30.911482 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:30.911927 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:30.913139 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:30.978417 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:30.986094 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-937cbf3c-04f5-45eb-805e-9dbe88f751da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1297 microversion: 2.1 time: 0.088357 Aug 09 19:16:30.986658 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 178/355] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:30 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:31.497673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:31.498293 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:31.505482 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:31.506798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:31.507428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:31.508275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:31.508796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:31.509228 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:31.659094 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:31.668146 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:31.669864 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:31.671336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c35274b3-7d6d-4a2b-b2b8-27334da98d57 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.177696 Aug 09 19:16:31.672131 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 178/356] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:31 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:32.009805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:32.011094 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:32.021294 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:32.022100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:32.022873 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:32.023749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:32.024358 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:32.025114 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:32.118118 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:32.126423 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-aac04f4f-a14d-43df-a4fb-dbc352b7352e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1297 microversion: 2.1 time: 0.121562 Aug 09 19:16:32.127392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 179/357] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:32 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1297 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:32.619830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-387882c0-f305-4bcb-9a3e-768a139aaa76 req-ff016be9-18e7-4c36-8546-775b11f8bea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5249124-ef8d-4931-8114-ad85549b447c", "name": "network-vif-plugged", "status": "completed", "tag": "02edcf89-39d2-4084-b64b-2b2ce84d06d8"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:32.634022 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-387882c0-f305-4bcb-9a3e-768a139aaa76 req-ff016be9-18e7-4c36-8546-775b11f8bea8 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:32.634912 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-387882c0-f305-4bcb-9a3e-768a139aaa76 req-ff016be9-18e7-4c36-8546-775b11f8bea8 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:32.635605 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-387882c0-f305-4bcb-9a3e-768a139aaa76 req-ff016be9-18e7-4c36-8546-775b11f8bea8 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:32.674365 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-387882c0-f305-4bcb-9a3e-768a139aaa76 req-ff016be9-18e7-4c36-8546-775b11f8bea8 service nova] Creating event network-vif-plugged:02edcf89-39d2-4084-b64b-2b2ce84d06d8 for instance b5249124-ef8d-4931-8114-ad85549b447c on hv-cinder-85265 Aug 09 19:16:32.681762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-387882c0-f305-4bcb-9a3e-768a139aaa76 req-ff016be9-18e7-4c36-8546-775b11f8bea8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067707 Aug 09 19:16:32.683044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 179/358] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:32.711299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:32.715856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:32.737349 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:32.737871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:32.738541 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:32.749432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:32.750310 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:32.750812 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:33.081225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:33.100557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:33.103506 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:33.105022 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7471d298-2c8d-4a86-a178-e709efaf1dfe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.413672 Aug 09 19:16:33.122623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 180/359] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:32 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:33.156830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:33.157399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:33.170528 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:33.171379 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:33.172143 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:33.173705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:33.175090 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:33.175913 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:33.292144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:33.304066 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0a22174c-e137-493c-8965-757c7eec594d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1303 microversion: 2.1 time: 0.154475 Aug 09 19:16:33.304704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 180/360] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:33 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:34.135758 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:34.136356 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:34.149689 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:34.152565 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:34.153331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:34.154298 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:34.155087 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:34.155524 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:34.336238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:34.338462 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:34.375123 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:34.376802 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:34.377711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:34.379375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:34.380175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:34.380955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:34.507266 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:34.516917 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:34.518669 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:34.520764 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-bfdda988-112e-45fe-860d-c17a9a105bbb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.388789 Aug 09 19:16:34.540655 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 181/361] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:34 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:34.857113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:34.887172 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-df8997dc-0c23-4d62-9cfb-7ae4ca700863 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.553411 Aug 09 19:16:34.897018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 181/362] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:34 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:35.547784 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:35.549607 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:35.560173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:35.565298 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:35.565766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:35.568694 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:35.569241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:35.569679 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:35.811946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:35.825143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:35.827295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:35.828978 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2fb32c01-af8a-4d9c-91a1-5c380a1af052 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.285699 Aug 09 19:16:35.830180 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 182/363] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:35 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:35.920938 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:35.921585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:35.936081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:35.941654 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:35.947937 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:35.950405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:35.953095 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:35.954932 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:36.398215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:36.408527 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1cdcf6ec-5b3a-4722-92a1-ddfad3d6fec9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.492812 Aug 09 19:16:36.409011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 182/364] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:35 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:36.546883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-cd49251d-f9eb-4976-82b2-b8dfaf1d49b9 req-17c6b51b-5d0c-4d12-8c07-d62f4bf7650f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cf279d-dd85-42fc-93c9-4fc91e972306", "tag": "cddca46a-78ca-473b-b9f0-e1a051f447e5"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:36.611333 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-cd49251d-f9eb-4976-82b2-b8dfaf1d49b9 req-17c6b51b-5d0c-4d12-8c07-d62f4bf7650f service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:36.617187 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-cd49251d-f9eb-4976-82b2-b8dfaf1d49b9 req-17c6b51b-5d0c-4d12-8c07-d62f4bf7650f service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:36.618289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-cd49251d-f9eb-4976-82b2-b8dfaf1d49b9 req-17c6b51b-5d0c-4d12-8c07-d62f4bf7650f service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:36.657547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-cd49251d-f9eb-4976-82b2-b8dfaf1d49b9 req-17c6b51b-5d0c-4d12-8c07-d62f4bf7650f service nova] Creating event network-changed:cddca46a-78ca-473b-b9f0-e1a051f447e5 for instance 62cf279d-dd85-42fc-93c9-4fc91e972306 on hv-cinder-85265 Aug 09 19:16:36.665457 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-cd49251d-f9eb-4976-82b2-b8dfaf1d49b9 req-17c6b51b-5d0c-4d12-8c07-d62f4bf7650f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126522 Aug 09 19:16:36.667002 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 183/365] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:36.859722 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:36.860713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:36.884356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:36.886834 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:36.890241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:36.895102 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:36.897599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:36.900138 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:37.040373 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:37.041247 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:37.054819 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:37.055589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:37.056190 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:37.057077 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:37.060149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:37.060867 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:37.232198 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:37.244710 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:37.250513 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:37.254781 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6e2d237c-d353-48bc-a563-903b12a07238 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.402689 Aug 09 19:16:37.257754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 183/366] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:36 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:37.321094 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lazy-loading 'services' on Instance uuid 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:16:37.431922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:37.432555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:37.444156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:37.445175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:37.445622 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:37.448986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:37.450455 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:37.452027 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:37.494182 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2c7a697d-06e7-4bb6-98aa-7ea9d747ec58 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9/os-volume_attachments/d5f7dc69-568d-4d41-b1f7-909c65b79044" status: 202 len: 0 microversion: 2.1 time: 0.458954 Aug 09 19:16:37.495520 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 184/367] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:16:37 2022] DELETE /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9/os-volume_attachments/d5f7dc69-568d-4d41-b1f7-909c65b79044 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:16:37.860911 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:37.877922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-140707ca-4689-4ed1-a47a-c564873533c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.451572 Aug 09 19:16:37.879060 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 184/368] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:37 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:38.283033 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:38.283723 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:38.294304 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:38.294796 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:38.295225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:38.295933 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:38.296376 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:38.298599 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:38.724283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:38.742797 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:38.813161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:38.815092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:38.818957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-41282d5f-7c92-4da9-95af-c7ab28bd7ce7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.540121 Aug 09 19:16:38.823845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 185/369] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:38 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:38.835636 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:38.839124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=6 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:38.849967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:38.852955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:38.885883 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:38.895618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:38.897979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:38.900454 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:38.901325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:38.902662 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:38.903262 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:38.905620 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:38.912602 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:38.915633 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:38.916266 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:38.917282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:38.921806 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:38.922455 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:38.967476 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:16:39.150504 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4a622857-251d-4411-bb51-8d9fea16b27e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 204 len: 0 microversion: 2.1 time: 0.345921 Aug 09 19:16:39.154332 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 185/370] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:16:38 2022] DELETE /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:16:39.176903 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:39.183425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:39.202077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:39.202578 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:39.204644 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:39.211212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:39.211717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:39.212219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:39.278469 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:39.288268 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3555d6aa-0fd2-4e63-a54a-83596920fada tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.392694 Aug 09 19:16:39.290450 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 186/371] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:38 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:39.499711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:39.509593 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-58169b7b-5e05-44b9-b973-e6ffddd054d4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1514 microversion: 2.1 time: 0.350169 Aug 09 19:16:39.510183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 186/372] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:39 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1514 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:39.889053 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:39.890221 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:39.898043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:39.898870 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:39.899529 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:39.900460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:39.900980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:39.901467 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:39.929850 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:40.125704 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:40.149359 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:40.154243 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:40.156299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-529170d1-d942-4f0a-9970-5900b8263b4e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.276524 Aug 09 19:16:40.157165 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 187/373] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:39 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:40.316943 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:40.330545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:40.352310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:40.354082 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:40.356528 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:40.359196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:40.363367 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:40.364670 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:40.535344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:40.536152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:40.560661 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:40.561170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:40.561617 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:40.562347 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:40.574838 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:40.575306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:40.648262 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:40.666664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-acebb885-dd0d-4937-a4ce-0bf007073215 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.355222 Aug 09 19:16:40.672372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 187/374] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:40 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:40.892660 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:40.903287 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a33da8e4-3e54-4ae9-b9a3-d0a490b2c502 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1514 microversion: 2.1 time: 0.373722 Aug 09 19:16:40.908558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 188/375] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:40 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1514 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:41.184246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:41.184805 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:41.191044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:41.191641 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:41.192406 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:41.193963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:41.194945 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:41.195616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:41.398207 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:41.408351 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:41.410164 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:41.411632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a9421e6a-083c-4950-8c79-562ff9ef8883 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.231785 Aug 09 19:16:41.412974 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 188/376] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:41 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:41.704344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:41.705683 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:41.713591 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:41.714507 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:41.715051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:41.726934 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:41.730147 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:41.737051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:41.910284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:41.920021 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-efe241b1-a374-42e5-8cb9-dc43da6a4cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.220311 Aug 09 19:16:41.934340 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 189/377] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:41 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:41.944293 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:41.945188 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:41.952011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:41.952525 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:41.952957 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:41.953645 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:41.954090 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:41.954557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:42.129145 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:42.138804 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-393c4d40-1ef5-4a71-a5c0-00fcc57a61df tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1514 microversion: 2.1 time: 0.215713 Aug 09 19:16:42.139780 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 189/378] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:41 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1514 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:42.437486 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:42.438344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:42.445472 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:42.453857 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:42.454210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:42.454955 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:42.455412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:42.455834 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:42.635420 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:42.656146 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:42.658007 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:42.659216 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4eaf6b88-2be0-43b7-bff9-880ff5d39af7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.225768 Aug 09 19:16:42.659775 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 190/379] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:42 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:42.885244 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-481d2e90-fc6c-4887-b4e5-fe5679516d72 req-bb583f4e-884d-4899-9c53-21013219964d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9", "name": "network-vif-deleted", "tag": "6dc7356a-6680-4ca1-9249-40bd42680544"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:42.899209 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-481d2e90-fc6c-4887-b4e5-fe5679516d72 req-bb583f4e-884d-4899-9c53-21013219964d service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:42.900607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-481d2e90-fc6c-4887-b4e5-fe5679516d72 req-bb583f4e-884d-4899-9c53-21013219964d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:42.901214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-481d2e90-fc6c-4887-b4e5-fe5679516d72 req-bb583f4e-884d-4899-9c53-21013219964d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:42.925497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-481d2e90-fc6c-4887-b4e5-fe5679516d72 req-bb583f4e-884d-4899-9c53-21013219964d service nova] Creating event network-vif-deleted:6dc7356a-6680-4ca1-9249-40bd42680544 for instance 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 on hv-cinder-85265 Aug 09 19:16:42.941272 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-481d2e90-fc6c-4887-b4e5-fe5679516d72 req-bb583f4e-884d-4899-9c53-21013219964d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053416 Aug 09 19:16:42.942323 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 190/380] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:42.949492 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:42.950609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:42.961093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:42.962080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:42.962812 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:42.963739 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:42.964969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:42.966343 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:43.171839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:43.172782 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:43.183354 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:43.184164 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:43.185113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:43.186175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:43.186820 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:43.187537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:43.228625 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:43.229445 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:43.230173 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:43.230827 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lazy-loading 'fault' on Instance uuid 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:16:43.234633 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:43.239359 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:43.250862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5232e8c1-ce64-4121-a262-f6fa66c22921 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.306569 Aug 09 19:16:43.253375 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 191/381] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:42 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:43.309605 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:43.317667 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-15380aad-d2fc-4ba7-a0aa-c254277cbb82 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 200 len: 1309 microversion: 2.1 time: 0.150697 Aug 09 19:16:43.332737 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 191/382] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:43 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:43.682619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:43.683270 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:43.690354 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:43.691067 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:43.691505 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:43.692494 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:43.693510 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:43.694198 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:43.864354 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:43.875730 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:43.877290 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:43.878734 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2c698b19-2c7d-4726-9aad-b4b19f32fd21 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.200015 Aug 09 19:16:43.892961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 192/383] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:43 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:44.276794 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:44.278664 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:44.284829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:44.285698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:44.286364 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:44.288551 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:44.289103 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:44.289734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:44.346100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:44.350353 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:44.369021 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:44.370843 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:44.371694 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:44.373071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:44.373664 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:44.376893 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:44.407594 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] HTTP exception thrown: Instance 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 could not be found. Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Request method failure captured: Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 HTTP/1.1 Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rJBw2UlnKpLsrOqmV5I6Zr-sM7msPBmkxNSFfsvmUrTbf2WqA02hJZMMeEfrYojbRCOalg3ky-bITu_2ZYtKtbhBRxkY15PndK3EfKCWjbZG2juS8UfpBkMY68x9SPeMqlzToTi5jBUWVDxkFxRzWEnr9Hj_iVY58oLWLu9Mtw--I4 Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 37a9557289ea4fe9903f6cf421d937d1 Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1119513580 Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:16:44.409225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37a9557289ea4fe9903f6cf421d937d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/37a9557289ea4fe9903f6cf421d937d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37a9557289ea4fe9903f6cf421d937d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_37a9557289ea4fe9903f6cf421d937d1"}]}] Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-VolumesSnapshotTestJSON-1119513580 Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 37a9557289ea4fe9903f6cf421d937d1 Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1119513580 Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-VolumesSnapshotTestJSON-1119513580-project Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 871ff162be0b43c98b531e860f6a02e5 Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-VolumesSnapshotTestJSON-1119513580-project Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 could not be found. Aug 09 19:16:44.410606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': '6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9'} Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 could not be found. Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:16:44.411346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 could not be found. Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 could not be found. Aug 09 19:16:44.412687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:16:44.414559 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Returning 404 to user: Instance 6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:16:44.415880 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-06373aed-7e43-417f-8a17-67dd348c7773 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9" status: 404 len: 111 microversion: 2.1 time: 0.079607 Aug 09 19:16:44.416907 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 193/384] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:44 2022] GET /compute/v2.1/servers/6965f6f8-fafe-4e8a-b2a7-65adf5fc5cb9 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 19:16:44.514248 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:44.531055 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-dee8d0c4-8281-4354-8ce5-0991042d9cf6 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.259781 Aug 09 19:16:44.532337 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 192/385] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:44 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:44.921425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:44.922110 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:44.945299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:44.946532 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:44.946974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:44.947707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:44.948152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:44.948600 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:45.105683 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-b1573a96-f376-4c39-8e7b-bda7e0fd647c req-67402255-3e25-4d4d-a355-6d15c3715b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cf279d-dd85-42fc-93c9-4fc91e972306", "name": "network-vif-plugged", "status": "completed", "tag": "cddca46a-78ca-473b-b9f0-e1a051f447e5"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:45.118095 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-b1573a96-f376-4c39-8e7b-bda7e0fd647c req-67402255-3e25-4d4d-a355-6d15c3715b96 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:45.118968 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-b1573a96-f376-4c39-8e7b-bda7e0fd647c req-67402255-3e25-4d4d-a355-6d15c3715b96 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:45.119596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-b1573a96-f376-4c39-8e7b-bda7e0fd647c req-67402255-3e25-4d4d-a355-6d15c3715b96 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:45.140023 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-b1573a96-f376-4c39-8e7b-bda7e0fd647c req-67402255-3e25-4d4d-a355-6d15c3715b96 service nova] Creating event network-vif-plugged:cddca46a-78ca-473b-b9f0-e1a051f447e5 for instance 62cf279d-dd85-42fc-93c9-4fc91e972306 on hv-cinder-85265 Aug 09 19:16:45.147711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-b1573a96-f376-4c39-8e7b-bda7e0fd647c req-67402255-3e25-4d4d-a355-6d15c3715b96 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048059 Aug 09 19:16:45.149138 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 193/386] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:45.482404 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:45.495528 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:45.500252 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:45.506609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ae39a01e-53f6-430e-99f0-5d10a58c2bf9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.601396 Aug 09 19:16:45.512619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 194/387] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:44 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:45.556979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:45.558016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:45.573566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:45.576468 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:45.579448 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:45.580592 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:45.587980 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:45.588679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:45.787375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:45.802808 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-20612ef9-29e1-4bc5-b6cd-873817add82c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.252164 Aug 09 19:16:45.805013 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 194/388] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:45 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:46.536361 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:46.538828 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:46.556287 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:46.558055 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:46.560653 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:46.563841 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:46.564676 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:46.565456 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:46.799180 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:46.810574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:46.812547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:46.814044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-42a6c3d0-eafd-4b94-a3cc-2d1d37d944a5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.282554 Aug 09 19:16:46.815226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 195/389] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:46 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:46.832985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:46.835217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:46.854016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:46.860951 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:46.861399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:46.862136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:46.862610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:46.865407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:47.174359 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:47.184596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f1991b0c-7cdf-4cc4-b49d-ebb486358981 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.363300 Aug 09 19:16:47.186123 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 195/390] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:46 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:16:47.841948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:47.844114 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:47.867816 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:47.869044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:47.869989 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:47.871191 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:47.871868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:47.872891 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:48.216118 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:48.216765 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:48.227483 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:48.228342 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:48.229180 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:48.230491 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:48.231351 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:48.232118 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:48.265303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:48.288837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:48.289081 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:48.290397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b93f043c-cdee-4e78-9c1c-02ee1a52e195 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1737 microversion: 2.20 time: 0.455299 Aug 09 19:16:48.291044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 196/391] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:47 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1737 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:48.484297 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:48.494019 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a66e7488-2167-400a-bc88-6cf521487b56 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.281601 Aug 09 19:16:48.511220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 196/392] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:48 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:16:49.314055 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:49.315514 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:49.325278 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:49.325766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:49.327042 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:49.327910 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:49.328536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:49.329230 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:49.524684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:49.526044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:49.536819 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:49.537436 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:49.537989 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:49.538704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:49.539162 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:49.539581 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:49.571027 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:49.585812 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:49.588606 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:49.589892 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1283f82e-a5ff-4beb-8103-e021173d11d8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1719 microversion: 2.20 time: 0.279496 Aug 09 19:16:49.590643 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 197/393] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:49 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1719 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:50.191387 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:50.204982 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-70827a95-1055-453d-b820-a4f72ef415d3 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1370 microversion: 2.1 time: 0.686797 Aug 09 19:16:50.218289 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 197/394] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:49 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1370 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:16:50.616207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:50.617667 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:50.626016 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:50.627538 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:50.628198 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:50.629334 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:50.630918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:50.631804 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:50.788173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:50.796988 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:50.798770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:50.800225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2a46f3ce-93d8-411e-af66-770802f988c1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1719 microversion: 2.20 time: 0.190683 Aug 09 19:16:50.801295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 198/395] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:50 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:51.228375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:51.229629 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:51.238137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:51.239194 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:51.239680 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:51.242100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:51.242713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:51.243307 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:51.525449 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:51.546569 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fe3cc5a3-e03d-4c9e-bded-3d97e3fba749 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1565 microversion: 2.1 time: 0.322736 Aug 09 19:16:51.547175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 198/396] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:51 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1565 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:51.571611 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ee6dfadf-a329-4e4a-b9a3-d94081cb1c04 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:51.572112 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ee6dfadf-a329-4e4a-b9a3-d94081cb1c04 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:51.582045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee6dfadf-a329-4e4a-b9a3-d94081cb1c04 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:51.582544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee6dfadf-a329-4e4a-b9a3-d94081cb1c04 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:51.582987 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee6dfadf-a329-4e4a-b9a3-d94081cb1c04 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:51.583959 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee6dfadf-a329-4e4a-b9a3-d94081cb1c04 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:51.584771 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee6dfadf-a329-4e4a-b9a3-d94081cb1c04 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:51.585220 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee6dfadf-a329-4e4a-b9a3-d94081cb1c04 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:51.698328 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ee6dfadf-a329-4e4a-b9a3-d94081cb1c04 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133400 Aug 09 19:16:51.699332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 199/397] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Aug 9 19:16:51 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:51.826565 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:51.827362 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:51.837573 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:51.838863 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:51.839316 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:51.840421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:51.840930 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:51.841414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:52.007706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:52.017980 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:52.019933 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:52.022615 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-116e1275-7fea-4853-bc73-83559f24051a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1719 microversion: 2.20 time: 0.201315 Aug 09 19:16:52.023247 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 199/398] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:51 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1719 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:52.679998 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-fa0488e5-f1a7-4bdf-867b-0aa04c00ef14 req-6bad6125-f66e-42c5-bab7-7d6c6decbabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5249124-ef8d-4931-8114-ad85549b447c", "name": "network-vif-unplugged", "status": "completed", "tag": "02edcf89-39d2-4084-b64b-2b2ce84d06d8"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:52.695053 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-fa0488e5-f1a7-4bdf-867b-0aa04c00ef14 req-6bad6125-f66e-42c5-bab7-7d6c6decbabb service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:52.696355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-fa0488e5-f1a7-4bdf-867b-0aa04c00ef14 req-6bad6125-f66e-42c5-bab7-7d6c6decbabb service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:52.697000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-fa0488e5-f1a7-4bdf-867b-0aa04c00ef14 req-6bad6125-f66e-42c5-bab7-7d6c6decbabb service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:52.716947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-fa0488e5-f1a7-4bdf-867b-0aa04c00ef14 req-6bad6125-f66e-42c5-bab7-7d6c6decbabb service nova] Creating event network-vif-unplugged:02edcf89-39d2-4084-b64b-2b2ce84d06d8 for instance b5249124-ef8d-4931-8114-ad85549b447c on hv-cinder-85265 Aug 09 19:16:52.729153 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-fa0488e5-f1a7-4bdf-867b-0aa04c00ef14 req-6bad6125-f66e-42c5-bab7-7d6c6decbabb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060339 Aug 09 19:16:52.730900 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 200/399] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:52.823911 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-118830235", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "networks": [{"uuid": "08408500-a901-4055-95fc-9e38338c0e51"}]}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:52.891005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] validate_networks() for [('08408500-a901-4055-95fc-9e38338c0e51', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:16:53.047379 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:53.048998 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:53.059126 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:53.060711 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:53.061387 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:53.062313 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:53.063103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:53.063754 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:53.291729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:16:53.292378 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:16:53.292976 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:16:53.293483 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:16:53.294125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:16:53.311247 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:53.311830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:53.312329 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:53.313143 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:53.313694 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:53.314342 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:53.332941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Getting quotas for project 37a9557289ea4fe9903f6cf421d937d1. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:16:53.342053 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Getting quotas for user 871ff162be0b43c98b531e860f6a02e5 and project 37a9557289ea4fe9903f6cf421d937d1. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:16:53.359665 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:16:53.362701 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:16:53.415017 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e6b9c160-586d-41e2-bc09-802f48db0fd0 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596828 Aug 09 19:16:53.416655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 200/400] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:16:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:16:53.428697 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-84d29647-ebae-47b3-b815-96898110c125 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:53.429233 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-84d29647-ebae-47b3-b815-96898110c125 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:53.545061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:53.550544 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-84d29647-ebae-47b3-b815-96898110c125 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:53.569133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-84d29647-ebae-47b3-b815-96898110c125 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1218 microversion: 2.1 time: 0.145113 Aug 09 19:16:53.572852 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 201/401] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:53 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:53.574832 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:53.576507 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:53.577717 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ce5412c5-4097-4ae4-8ba4-15c5bfea471b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1719 microversion: 2.20 time: 0.535512 Aug 09 19:16:53.579666 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 201/402] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:53 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1719 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:53.760760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-12798bd7-5d21-4c91-9cb2-2e02a0654db4 req-c7907f9f-a0bd-42ee-a40c-c6c9405db805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cf279d-dd85-42fc-93c9-4fc91e972306", "tag": "cddca46a-78ca-473b-b9f0-e1a051f447e5"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:53.775345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-12798bd7-5d21-4c91-9cb2-2e02a0654db4 req-c7907f9f-a0bd-42ee-a40c-c6c9405db805 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:53.776614 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-12798bd7-5d21-4c91-9cb2-2e02a0654db4 req-c7907f9f-a0bd-42ee-a40c-c6c9405db805 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:53.777315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-12798bd7-5d21-4c91-9cb2-2e02a0654db4 req-c7907f9f-a0bd-42ee-a40c-c6c9405db805 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:53.790125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-12798bd7-5d21-4c91-9cb2-2e02a0654db4 req-c7907f9f-a0bd-42ee-a40c-c6c9405db805 service nova] Creating event network-changed:cddca46a-78ca-473b-b9f0-e1a051f447e5 for instance 62cf279d-dd85-42fc-93c9-4fc91e972306 on hv-cinder-85265 Aug 09 19:16:53.795618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-12798bd7-5d21-4c91-9cb2-2e02a0654db4 req-c7907f9f-a0bd-42ee-a40c-c6c9405db805 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039038 Aug 09 19:16:53.800218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 202/403] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:16:54.594679 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:54.595870 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:54.607643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:54.608999 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:54.640285 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:54.644867 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:54.646401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:54.647164 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:54.657117 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:54.660575 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:54.662944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:54.665017 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:54.666324 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:54.666560 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:54.667261 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:54.670786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:55.111177 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:55.126343 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-11a75017-73ef-4853-a588-c3c6ef44f844 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1214 microversion: 2.1 time: 0.535785 Aug 09 19:16:55.144338 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 202/404] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:54 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1214 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:55.154405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:55.167125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:55.168751 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:55.170945 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2cd5a08c-3b14-4d2b-8f30-766bc67cb4a1 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1719 microversion: 2.20 time: 0.569367 Aug 09 19:16:55.172430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 203/405] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:54 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1719 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:56.152783 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:56.153504 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:56.185922 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:56.188161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:56.189059 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:56.191984 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:56.198878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:56.200309 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:56.205790 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:56.209482 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:56.212971 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:56.216556 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:56.217261 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:56.218353 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:56.219144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:56.220419 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:56.496475 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:56.513892 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7bb755ca-3318-46db-9ff2-d75706d00dce tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1276 microversion: 2.1 time: 0.365502 Aug 09 19:16:56.532061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 203/406] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:56 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1276 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:56.559651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:56.571689 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:56.573956 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:56.575225 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-05e9ed94-52fa-4189-87a6-419b6f7e89cc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1662 microversion: 2.20 time: 0.380948 Aug 09 19:16:56.577165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 204/407] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:56 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1662 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:56.599430 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-384db41b-e4be-43d1-9f8f-a9e66c823e5e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ddfb7900-93ee-4c57-b976-f3d4d9e7417f"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:56.603082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-384db41b-e4be-43d1-9f8f-a9e66c823e5e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:56.615821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-384db41b-e4be-43d1-9f8f-a9e66c823e5e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:56.620665 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-384db41b-e4be-43d1-9f8f-a9e66c823e5e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:56.621712 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-384db41b-e4be-43d1-9f8f-a9e66c823e5e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:56.622890 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-384db41b-e4be-43d1-9f8f-a9e66c823e5e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:56.623349 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-384db41b-e4be-43d1-9f8f-a9e66c823e5e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:56.623926 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-384db41b-e4be-43d1-9f8f-a9e66c823e5e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:56.942150 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:57.164335 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-384db41b-e4be-43d1-9f8f-a9e66c823e5e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.569097 Aug 09 19:16:57.166468 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 204/408] 10.222.0.70 () {62 vars in 1364 bytes} [Tue Aug 9 19:16:56 2022] POST /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments => generated 188 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:16:57.372952 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:57.374400 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:57.397360 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:57.398218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:57.398941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:57.399965 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:57.400702 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:57.401339 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:57.456568 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:16:57.465601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117822) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 19:16:57.541250 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:57.541863 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:57.554643 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:57.555130 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:57.555562 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:57.556273 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:57.560669 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:57.561507 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:57.591807 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-acce8614-d534-4b56-a293-047a61ac10de tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/action" status: 202 len: 0 microversion: 2.20 time: 0.222952 Aug 09 19:16:57.595402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 205/409] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Aug 9 19:16:57 2022] POST /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:16:57.609148 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:57.609938 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:57.624191 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:57.625468 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:57.628910 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:57.629829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:57.633814 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:57.636457 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:57.808830 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:57.821357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a3e915e2-ad22-408f-b482-1b5248de310a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1276 microversion: 2.1 time: 0.286052 Aug 09 19:16:57.829141 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 205/410] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:57 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1276 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:16:57.940089 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:57.956274 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:57.958037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:57.960026 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-53ca6b68-182c-4cc0-8ea7-a198a58f8427 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1748 microversion: 2.20 time: 0.359343 Aug 09 19:16:57.961585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 206/411] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:57 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1748 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:16:58.854341 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:58.854877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:58.868651 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:58.869157 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:58.869595 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:58.870314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:58.870767 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:58.871191 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:58.985111 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:16:58.985824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:16:59.001657 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:59.002158 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:59.002600 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:59.003402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:59.003858 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:59.004367 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:59.222014 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:59.232600 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:59.234840 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:59.236247 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-99c0e4c6-95da-49ab-b6d1-ca7dc3a9a7b0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1748 microversion: 2.20 time: 0.255912 Aug 09 19:16:59.249535 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 207/412] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:16:58 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1748 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:16:59.322855 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:16:59.335127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ac67425b-b89a-468c-bcaa-e2218e4ddad7 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.484657 Aug 09 19:16:59.336208 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 206/413] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:16:58 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:16:59.825365 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-9b790a24-a8cf-4a64-baae-b98d4563a0c6 req-ba07a7ba-4f8c-4a5c-a1c1-21f779284f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d4c8440-6012-4bb7-bec2-449fd00524dd", "tag": "09db18c3-10c7-48df-9fca-42b6a06d9732"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:16:59.836606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-9b790a24-a8cf-4a64-baae-b98d4563a0c6 req-ba07a7ba-4f8c-4a5c-a1c1-21f779284f72 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:16:59.837327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-9b790a24-a8cf-4a64-baae-b98d4563a0c6 req-ba07a7ba-4f8c-4a5c-a1c1-21f779284f72 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:16:59.837855 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-9b790a24-a8cf-4a64-baae-b98d4563a0c6 req-ba07a7ba-4f8c-4a5c-a1c1-21f779284f72 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:16:59.851884 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-9b790a24-a8cf-4a64-baae-b98d4563a0c6 req-ba07a7ba-4f8c-4a5c-a1c1-21f779284f72 service nova] Creating event network-changed:09db18c3-10c7-48df-9fca-42b6a06d9732 for instance 6d4c8440-6012-4bb7-bec2-449fd00524dd on hv-cinder-85265 Aug 09 19:16:59.857493 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-9b790a24-a8cf-4a64-baae-b98d4563a0c6 req-ba07a7ba-4f8c-4a5c-a1c1-21f779284f72 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036692 Aug 09 19:16:59.858480 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 208/414] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:00.262481 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:00.263092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:00.273125 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:00.273621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:00.274059 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:00.274811 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:00.275201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:00.275798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:00.359086 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:00.359884 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:00.366777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:00.367532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:00.368039 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:00.368846 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:00.369551 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:00.370050 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:00.598258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:00.607900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5b191b52-9f58-4bfb-b413-5200504e7173 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.254200 Aug 09 19:17:00.608518 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 209/415] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:00 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:17:00.815136 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:00.827809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:00.830000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:00.832051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ee8dc282-3ffb-4b64-8568-18c295179f4f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.573757 Aug 09 19:17:00.832885 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 207/416] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:00 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:00.942135 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c530589c-6247-4eee-ad7f-c1d50da24d16 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Action: 'create', calling method: .version_select at 0x7fa50818eca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-205325892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5WllTcvVxeewgGyBsC3PJc+mFTRyUlA8N2/1/zVCWg606pvHGd5P/f6FZXZ6aPrCUidjslSysooHriv/brNz4w4AWeaUsbXlGHax0dm5dSPOyPceHSGASmhQGRlpqlDw=="}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:00.959029 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-c530589c-6247-4eee-ad7f-c1d50da24d16 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Getting quotas for project faf0c6e98206493ea25654f44c9ae563. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:17:00.963469 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-c530589c-6247-4eee-ad7f-c1d50da24d16 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Getting quotas for user f12cfb692b4b4947bc67a3199aa33e73 and project faf0c6e98206493ea25654f44c9ae563. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:17:00.989013 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c530589c-6247-4eee-ad7f-c1d50da24d16 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.179288 Aug 09 19:17:00.990523 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 210/417] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:17:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:01.576100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-79128f0e-0045-4489-bee0-df8c5f0cf47b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:01.576624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-79128f0e-0045-4489-bee0-df8c5f0cf47b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:01.582643 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=60 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:01.585626 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79128f0e-0045-4489-bee0-df8c5f0cf47b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:01.586448 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79128f0e-0045-4489-bee0-df8c5f0cf47b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:01.587485 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79128f0e-0045-4489-bee0-df8c5f0cf47b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:01.588184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79128f0e-0045-4489-bee0-df8c5f0cf47b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:01.589187 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79128f0e-0045-4489-bee0-df8c5f0cf47b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:01.589618 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79128f0e-0045-4489-bee0-df8c5f0cf47b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:01.615970 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-79128f0e-0045-4489-bee0-df8c5f0cf47b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/ips" status: 200 len: 146 microversion: 2.1 time: 0.043622 Aug 09 19:17:01.617168 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 208/418] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:17:01 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:01.629541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:01.630441 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:01.642642 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:01.644347 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:01.644347 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:01.644347 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:01.644719 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:01.645145 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:01.861782 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:01.862727 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:01.875292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:01.876093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:01.876776 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:01.884603 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:01.885256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:01.885701 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:02.105549 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:02.111303 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:02.120405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f4664ee5-03b5-434b-9d9e-b1f240b82a4e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.494042 Aug 09 19:17:02.121548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 211/419] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:01 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:02.260484 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:02.282440 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:02.288472 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:02.291455 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0dfae2bc-d63c-4caf-93a0-8e53401f682b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.438237 Aug 09 19:17:02.293203 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 209/420] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:01 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:03.143424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:03.144137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:03.155968 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:03.156478 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:03.156914 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:03.162370 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:03.163092 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:03.163699 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:03.315796 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:03.317295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:03.323299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:03.335993 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:03.337266 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:03.337911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:03.339303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:03.340034 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:03.340780 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:03.413764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:03.422528 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0795fd20-10cb-4ece-895b-f5cb2b466d0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.284261 Aug 09 19:17:03.423887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 212/421] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:03 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:03.656101 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:03.672017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:03.676677 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:03.679411 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2a3bd0df-85b6-4879-8875-486560326312 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.367910 Aug 09 19:17:03.681343 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 210/422] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:03 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:04.449999 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:04.450683 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:04.457553 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:04.458375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:04.458979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:04.459838 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:04.460452 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:04.461035 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:04.711579 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:04.712189 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:04.719217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:04.727782 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-518c1d69-3146-440b-9378-b295bd3c6a1f tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.281834 Aug 09 19:17:04.728874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 213/423] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:04 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:04.731842 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:04.732326 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:04.732789 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:04.733487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:04.733930 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:04.734345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:04.924982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:04.935112 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:04.937032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:04.938193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-92fb02dc-cd76-4478-8608-f099fe4d7979 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.237239 Aug 09 19:17:04.938914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 211/424] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:04 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:05.421310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b1ded6f3-2cc2-493a-9bbe-41491bfdca7b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "014dbb3d-62dc-409e-b421-35adcf086287"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:05.424374 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b1ded6f3-2cc2-493a-9bbe-41491bfdca7b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:05.430960 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b1ded6f3-2cc2-493a-9bbe-41491bfdca7b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:05.431669 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b1ded6f3-2cc2-493a-9bbe-41491bfdca7b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:05.432260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b1ded6f3-2cc2-493a-9bbe-41491bfdca7b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:05.433160 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b1ded6f3-2cc2-493a-9bbe-41491bfdca7b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:05.433758 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b1ded6f3-2cc2-493a-9bbe-41491bfdca7b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:05.434329 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b1ded6f3-2cc2-493a-9bbe-41491bfdca7b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:05.750445 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:05.751068 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:05.760492 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:05.761468 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:05.762142 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:05.762968 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:05.763531 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:05.764072 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:05.923872 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:05.938599 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-318438b7-39b1-4691-bb9b-9e9bfdae47c1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.191891 Aug 09 19:17:05.939535 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 212/425] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:05 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:17:05.962955 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:05.963471 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:05.970448 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:05.971022 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:05.971656 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:05.972363 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:05.972831 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:05.973240 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:06.128225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:06.139895 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:06.141534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:06.143122 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-569fe38e-243b-48df-b643-9fec088ab00e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.184822 Aug 09 19:17:06.143695 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 213/426] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:05 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:06.606541 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-2fa4b05a-fa4d-4f24-8ba3-3a282750ce69 req-e7745cd6-d8d2-4f18-b50e-e8a2e9ca0352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4c8440-6012-4bb7-bec2-449fd00524dd", "name": "network-vif-plugged", "status": "completed", "tag": "09db18c3-10c7-48df-9fca-42b6a06d9732"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:06.619353 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-2fa4b05a-fa4d-4f24-8ba3-3a282750ce69 req-e7745cd6-d8d2-4f18-b50e-e8a2e9ca0352 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:06.620191 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-2fa4b05a-fa4d-4f24-8ba3-3a282750ce69 req-e7745cd6-d8d2-4f18-b50e-e8a2e9ca0352 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:06.620859 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-2fa4b05a-fa4d-4f24-8ba3-3a282750ce69 req-e7745cd6-d8d2-4f18-b50e-e8a2e9ca0352 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:06.635186 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-2fa4b05a-fa4d-4f24-8ba3-3a282750ce69 req-e7745cd6-d8d2-4f18-b50e-e8a2e9ca0352 service nova] Creating event network-vif-plugged:09db18c3-10c7-48df-9fca-42b6a06d9732 for instance 6d4c8440-6012-4bb7-bec2-449fd00524dd on hv-cinder-85265 Aug 09 19:17:06.640702 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-2fa4b05a-fa4d-4f24-8ba3-3a282750ce69 req-e7745cd6-d8d2-4f18-b50e-e8a2e9ca0352 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037755 Aug 09 19:17:06.641423 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 214/427] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:06.963458 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:06.964423 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:06.971973 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:06.972600 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:06.973164 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:06.974505 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:06.975232 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:06.975663 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:07.134078 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:07.142142 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-41bd93e2-6632-4676-b073-d427f7838f70 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.184548 Aug 09 19:17:07.142811 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 215/428] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:06 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:07.167263 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:07.167865 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:07.174402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:07.174888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:07.175334 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:07.176112 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:07.176754 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:07.177762 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:07.346393 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:07.362933 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:07.366256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:07.368255 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0a6da520-dfd0-4dd0-99c1-a3bdbcd81e7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.204925 Aug 09 19:17:07.369135 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 216/429] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:07 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:08.164986 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:08.165690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:08.173146 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:08.173943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:08.174381 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:08.175166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:08.175803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:08.176383 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:08.328180 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:08.336980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3e9c9e2e-088a-4e30-912e-a9870feab47c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.176524 Aug 09 19:17:08.337566 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 217/430] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:08 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:08.414133 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:08.414746 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:08.421759 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:08.422144 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:08.422592 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:08.423675 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:08.424323 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:08.424982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:08.569875 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:08.578660 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:08.580271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:08.581462 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ebc27adb-50c9-4b9f-b039-d65d20ac78dd tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.175243 Aug 09 19:17:08.582019 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 218/431] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:08 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:09.358618 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:09.359380 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:09.367661 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:09.368149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:09.368627 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:09.369416 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:09.370016 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:09.376475 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:09.531481 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:09.540303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ba6f5041-02b5-4ae5-8d67-5e9c90100dc6 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.185888 Aug 09 19:17:09.540922 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 219/432] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:09 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:17:09.606982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:09.607809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:09.615553 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:09.616092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:09.616629 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:09.617420 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:09.617936 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:09.618426 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:09.795110 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:09.799385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:09.807705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:09.809393 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:09.810576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-08ef0347-a29d-4fe4-837a-ddcc35457fc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.208060 Aug 09 19:17:09.811155 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 220/433] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:09 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:10.563330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:10.564940 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:10.573620 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:10.574108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:10.574775 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:10.575654 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:10.576105 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:10.576724 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:10.731547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:10.740364 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4069d3ff-2f22-4449-ad5b-1b1c376711e1 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.180279 Aug 09 19:17:10.740986 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 221/434] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:10 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:10.834201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:10.834813 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:10.841268 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:10.841737 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:10.842167 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:10.842870 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:10.843409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:10.843785 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:10.973133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=12 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:10.999032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:11.008820 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:11.010339 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:11.011513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a4fb3ce3-9fd4-4db2-aaba-9836646ac8ac tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.181839 Aug 09 19:17:11.012086 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 222/435] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:10 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:11.762573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:11.763281 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:11.769983 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:11.770468 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:11.771675 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:11.772367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:11.773191 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:11.773663 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:11.957026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:11.970966 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a2e533b2-141f-4b79-a272-4d3089cb15b8 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.212463 Aug 09 19:17:11.971821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 223/436] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:11 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:12.035281 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:12.035795 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:12.042101 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:12.042573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:12.042995 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:12.043677 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:12.044119 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:12.044564 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:12.190811 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:12.200608 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:12.202120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:12.203286 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-df3a4f13-31ff-4988-abfa-fdf548585c64 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.172036 Aug 09 19:17:12.203901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 224/437] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:12 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:12.836545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b1ded6f3-2cc2-493a-9bbe-41491bfdca7b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.421841 Aug 09 19:17:12.837217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 214/438] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:17:05 2022] POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/os-volume_attachments => generated 194 bytes in 7424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:12.991066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:12.991709 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:12.998192 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:12.998674 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:12.999120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:12.999826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:13.000283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:13.000762 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:13.138541 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:13.146025 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-50b08475-4a73-4e3a-8a94-b2171e7adeaf tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.158818 Aug 09 19:17:13.146665 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 225/439] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:12 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:13.227297 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:13.227887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:13.234831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:13.235337 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:13.235764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:13.236454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:13.236902 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:13.237315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:13.375924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:13.386769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:13.388315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:13.389528 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c17d4bb5-e745-4c51-bef3-64fc1fd7f2c8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.167068 Aug 09 19:17:13.393078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 215/440] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:13 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:14.167189 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:14.167824 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:14.174555 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:14.175033 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:14.175464 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:14.176149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:14.176634 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:14.177057 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:14.310193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:14.326365 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-55d39124-1428-4a9c-b471-a198cddf95ff tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1318 microversion: 2.1 time: 0.163086 Aug 09 19:17:14.326957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 226/441] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:14 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:14.415227 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:14.415829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:14.422278 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:14.423009 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:14.423441 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:14.424119 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:14.424619 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:14.425040 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:14.556901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:14.566480 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:14.567989 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:14.570275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-edfa0435-5ed1-4972-b323-3efc5eb593f2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.159028 Aug 09 19:17:14.570846 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 216/442] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:14 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:15.347495 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:15.348128 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:15.355123 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:15.355597 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:15.356020 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:15.356867 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:15.357371 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:15.357786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:15.492113 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:15.499586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f20be9f9-fa31-45d7-81bb-92d0c824cd0c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1507 microversion: 2.1 time: 0.156058 Aug 09 19:17:15.500150 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 227/443] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:15 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:15.519763 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-487471bf-f5f1-4a1b-a79e-8e006a0369b4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d273a07-53ca-49a6-85e1-b41e3ce9082b", "device": "/dev/sdb"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:15.523000 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-487471bf-f5f1-4a1b-a79e-8e006a0369b4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:15.529419 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-487471bf-f5f1-4a1b-a79e-8e006a0369b4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:15.529902 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-487471bf-f5f1-4a1b-a79e-8e006a0369b4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:15.530359 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-487471bf-f5f1-4a1b-a79e-8e006a0369b4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:15.531043 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-487471bf-f5f1-4a1b-a79e-8e006a0369b4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:15.531495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-487471bf-f5f1-4a1b-a79e-8e006a0369b4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:15.531918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-487471bf-f5f1-4a1b-a79e-8e006a0369b4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:15.593657 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:15.594257 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:15.600744 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:15.601228 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:15.601655 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:15.602342 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:15.602786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:15.603209 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:15.741492 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:15.751345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:15.753160 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:15.754519 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6ba4a411-6c78-4609-b4fd-b8176009eb4c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.164589 Aug 09 19:17:15.755264 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 228/444] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:15 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:15.778021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-487471bf-f5f1-4a1b-a79e-8e006a0369b4 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "POST /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261986 Aug 09 19:17:15.778951 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 217/445] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:17:15 2022] POST /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:16.778564 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:16.779171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:16.785757 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:16.786233 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:16.786663 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:16.787948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:16.788486 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:16.788914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:16.923110 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:16.931869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:16.933411 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:16.934556 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6314be54-df9a-45fe-90c3-5c9d35ff57f8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.159929 Aug 09 19:17:16.935120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 229/446] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:16 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:17.958839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:17.959527 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:17.966157 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:17.966629 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:17.967059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:17.967735 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:17.968175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:17.968616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:18.102403 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:18.110889 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:18.112459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:18.113620 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2e224184-c69d-4b03-8b87-1eba0a29f7d9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.159370 Aug 09 19:17:18.114180 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 218/447] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:17 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:19.135275 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:19.135964 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:19.142672 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:19.143183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:19.143615 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:19.144309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:19.144809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:19.145304 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:19.291573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:19.301451 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:19.302979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:19.304302 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5575f721-31af-44bf-aad6-76b8342b9d37 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.173004 Aug 09 19:17:19.304894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 230/448] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:19 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:19.399936 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1815917490", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-205325892", "security_groups": [{"name": "tempest-secgroup-smoke-1182586383"}], "block_device_mapping_v2": [{"uuid": "be35cdf9-d07a-4a94-b48e-8bf01877fd80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b9e53f99-225a-4b2a-8235-02ef2f63b2e3"}]}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:19.519436 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] validate_networks() for [('b9e53f99-225a-4b2a-8235-02ef2f63b2e3', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:17:19.902304 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:17:19.902729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:17:19.903241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:17:19.903646 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:17:19.904050 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:17:19.913211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:19.913684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:19.914112 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:19.914832 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:19.915280 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:19.915703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:19.933476 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Getting quotas for project faf0c6e98206493ea25654f44c9ae563. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:17:19.937407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Getting quotas for user f12cfb692b4b4947bc67a3199aa33e73 and project faf0c6e98206493ea25654f44c9ae563. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:17:19.994963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:17:19.997105 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be35cdf9-d07a-4a94-b48e-8bf01877fd80',volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:17:20.136237 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-099d5400-f08b-402e-b151-6695137c80cd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.740768 Aug 09 19:17:20.136922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 219/449] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:17:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:17:20.147744 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e92e2934-35a6-42c1-adbc-4b3bdef36e2c tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:20.148365 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e92e2934-35a6-42c1-adbc-4b3bdef36e2c tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:20.210648 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e92e2934-35a6-42c1-adbc-4b3bdef36e2c tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:20.218123 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e92e2934-35a6-42c1-adbc-4b3bdef36e2c tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1094 microversion: 2.1 time: 0.074079 Aug 09 19:17:20.219509 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 231/450] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:20 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:20.328736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:20.329422 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:20.338085 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:20.338674 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:20.339078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:20.340428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:20.341439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:20.341875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:20.487725 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:20.497266 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:20.498781 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:20.499943 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3a7c5680-a00a-4b7d-b5e0-48339a77c1e2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.175310 Aug 09 19:17:20.500531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 220/451] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:20 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:21.241767 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:21.242477 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:21.250799 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:21.251285 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:21.251728 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:21.252420 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:21.252898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:21.253322 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:21.346892 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:21.355713 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a92df89b-231b-4957-b745-1b7379ba4021 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1200 microversion: 2.1 time: 0.118112 Aug 09 19:17:21.356291 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 232/452] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:21 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:17:21.470554 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f264b65a-66f1-4489-9734-40b90cec342c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:21.477146 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f264b65a-66f1-4489-9734-40b90cec342c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:21.477627 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f264b65a-66f1-4489-9734-40b90cec342c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:21.478220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f264b65a-66f1-4489-9734-40b90cec342c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:21.525156 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:21.525769 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:21.532556 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:21.533053 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:21.533512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:21.534214 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:21.534665 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:21.535092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:21.539211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f264b65a-66f1-4489-9734-40b90cec342c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Going to try to stop instance {{(pid=117822) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 19:17:21.588404 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f264b65a-66f1-4489-9734-40b90cec342c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.121369 Aug 09 19:17:21.589343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 221/453] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:17:21 2022] POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:17:21.597323 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:21.598040 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:21.605736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:21.606230 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:21.607139 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:21.607893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:21.609550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:21.609550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:21.765526 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:21.765719 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:21.774182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-345225ab-c573-4c66-b9f6-54e33e816204 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.180876 Aug 09 19:17:21.774764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 222/454] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:21 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:17:21.774905 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:21.776334 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:21.777604 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-fdee813d-1c1f-4350-8d52-e0e1653544d7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.257123 Aug 09 19:17:21.778155 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 233/455] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:21 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:22.377482 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:22.378384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:22.385276 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:22.385998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:22.386435 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:22.387142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:22.387593 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:22.388018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:22.528983 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:22.538715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4add6f6a-1b4f-41a1-b45f-445f6501f7dd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1278 microversion: 2.1 time: 0.164986 Aug 09 19:17:22.539578 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 223/456] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:22 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:22.782119 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-0fa1c4ee-d2f7-4fe7-8a0f-ae02a9f496a2 req-06fe7583-3fa4-49d7-8a75-e024ce66b5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c627b1d-06ef-4702-9080-ee169c06437e", "tag": "1d0cc0a5-e01b-4194-b532-bc2554cfbc71"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:22.795777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:22.796393 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:22.807332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-0fa1c4ee-d2f7-4fe7-8a0f-ae02a9f496a2 req-06fe7583-3fa4-49d7-8a75-e024ce66b5b8 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:22.807648 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:22.807844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:22.808352 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:22.808771 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-0fa1c4ee-d2f7-4fe7-8a0f-ae02a9f496a2 req-06fe7583-3fa4-49d7-8a75-e024ce66b5b8 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:22.809452 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-0fa1c4ee-d2f7-4fe7-8a0f-ae02a9f496a2 req-06fe7583-3fa4-49d7-8a75-e024ce66b5b8 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:22.809633 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:22.810104 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:22.810638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:22.823558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-0fa1c4ee-d2f7-4fe7-8a0f-ae02a9f496a2 req-06fe7583-3fa4-49d7-8a75-e024ce66b5b8 service nova] Creating event network-changed:1d0cc0a5-e01b-4194-b532-bc2554cfbc71 for instance 1c627b1d-06ef-4702-9080-ee169c06437e on hv-cinder-85265 Aug 09 19:17:22.830308 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-0fa1c4ee-d2f7-4fe7-8a0f-ae02a9f496a2 req-06fe7583-3fa4-49d7-8a75-e024ce66b5b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051813 Aug 09 19:17:22.831267 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 234/457] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:17:22.838176 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:22.839226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:22.847644 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:22.848276 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:22.848867 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:22.850529 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:22.851218 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:22.851892 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:22.980934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:22.989463 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-59ba9dbe-be9f-43ae-9e9e-7421b130fd90 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.198209 Aug 09 19:17:22.990698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 224/458] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:22 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:17:23.112250 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:23.122435 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:23.123937 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:23.125201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f8e4cfbf-203a-4688-aecc-cf560ca9afbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.292631 Aug 09 19:17:23.125767 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 235/459] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:22 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:17:23.561957 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:23.562565 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:23.571338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:23.571828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:23.572274 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:23.573016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:23.573473 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:23.573914 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:23.596360 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:23.717053 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:23.724727 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9fda098a-73f2-4a66-8c08-0c613b41798e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1278 microversion: 2.1 time: 0.166501 Aug 09 19:17:23.725299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 225/460] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:23 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:24.011584 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:24.012199 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:24.019115 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:24.019617 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:24.020040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:24.020885 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:24.021355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:24.021777 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:24.151193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:24.151800 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:24.157809 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:24.158292 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:24.158726 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:24.159447 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:24.159894 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:24.160317 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:24.161426 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:24.170547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4c8b31c2-947a-4cca-b9f5-1030bbc5b75a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.163200 Aug 09 19:17:24.171122 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 236/461] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:24 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:24.296240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:24.305821 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:24.307344 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:24.308524 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1e63ce16-c299-468c-b4d0-ce32fbe5a847 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.162226 Aug 09 19:17:24.309073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 226/462] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:24 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:24.648710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-c6ba0956-52c7-4872-9786-0018ae237fe6 req-161d007d-f6b7-4d30-915a-828ef83dc5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5249124-ef8d-4931-8114-ad85549b447c", "name": "network-vif-plugged", "status": "completed", "tag": "02edcf89-39d2-4084-b64b-2b2ce84d06d8"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:24.658160 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c6ba0956-52c7-4872-9786-0018ae237fe6 req-161d007d-f6b7-4d30-915a-828ef83dc5c7 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:24.658712 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c6ba0956-52c7-4872-9786-0018ae237fe6 req-161d007d-f6b7-4d30-915a-828ef83dc5c7 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:24.659141 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c6ba0956-52c7-4872-9786-0018ae237fe6 req-161d007d-f6b7-4d30-915a-828ef83dc5c7 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:24.671623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-c6ba0956-52c7-4872-9786-0018ae237fe6 req-161d007d-f6b7-4d30-915a-828ef83dc5c7 service nova] Creating event network-vif-plugged:02edcf89-39d2-4084-b64b-2b2ce84d06d8 for instance b5249124-ef8d-4931-8114-ad85549b447c on hv-cinder-85265 Aug 09 19:17:24.677009 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-c6ba0956-52c7-4872-9786-0018ae237fe6 req-161d007d-f6b7-4d30-915a-828ef83dc5c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032508 Aug 09 19:17:24.677631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 237/463] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:24.747809 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:24.748449 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:24.754895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:24.755369 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:24.755792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:24.756499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:24.756981 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:24.757986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:24.898692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:24.906188 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-01100942-279a-48cb-a2e2-f546a437c0c1 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1278 microversion: 2.1 time: 0.162397 Aug 09 19:17:24.906747 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 227/464] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:24 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:25.194267 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:25.195922 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:25.202244 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:25.202796 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:25.203229 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:25.203914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:25.204354 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:25.204793 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:25.332732 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:25.333330 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:25.340029 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:25.340546 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:25.340989 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:25.341661 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:25.342103 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:25.342518 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:25.342624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:25.351208 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7c132647-2fe4-4331-a0de-f1e115d871c9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.161676 Aug 09 19:17:25.351905 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 238/465] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:25 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:25.476730 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:25.485091 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:25.486596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:25.487750 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-61ae8de3-0e14-4d5d-9a98-e255d6518648 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.158976 Aug 09 19:17:25.488304 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 228/466] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:25 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:25.928369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:25.929700 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:25.935645 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:25.936120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:25.936577 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:25.937261 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:25.937705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:25.938152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:26.066449 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:26.070066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:26.074792 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a6565ed8-47a9-43b8-9fb3-7a1eae7fb89a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1278 microversion: 2.1 time: 0.150332 Aug 09 19:17:26.075362 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 239/467] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:25 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:26.372968 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:26.373582 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:26.380587 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:26.381081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:26.381516 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:26.382381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:26.383154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:26.383593 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:26.519601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:26.526130 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:26.526773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:26.530854 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-310d178f-5f0b-451c-8a09-b4fdd341d51e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.161714 Aug 09 19:17:26.531437 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 229/468] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:26 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:26.535757 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:26.536266 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:26.536732 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:26.537432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:26.537882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:26.538886 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:26.682054 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:26.690994 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:26.692545 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:26.693685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c1f88de7-fea5-4539-b4a3-42f3348d860b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1806 microversion: 2.20 time: 0.185776 Aug 09 19:17:26.694243 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 240/469] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:26 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:27.095101 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:27.095713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:27.101768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:27.102250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:27.102682 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:27.103406 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:27.103859 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:27.104282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:27.241942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:27.249372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6ed2b466-292c-4537-b45e-23153e12c025 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1278 microversion: 2.1 time: 0.158224 Aug 09 19:17:27.249940 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 230/470] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:27 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:27.555092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:27.555621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:27.564289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:27.564806 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:27.565242 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:27.565933 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:27.566744 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:27.567359 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:27.705666 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:27.715099 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-15b311ec-f1c7-4ffe-bac2-2224f5e74c54 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.164616 Aug 09 19:17:27.715678 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 241/471] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:27 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:27.717446 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:27.718058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:27.720366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:27.726262 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:27.726752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:27.727182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:27.727906 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:27.728359 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:27.728806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:27.861955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:27.871228 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:27.872753 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:27.873903 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c5c5abca-71aa-4063-a5c1-d90b283be346 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1793 microversion: 2.20 time: 0.160566 Aug 09 19:17:27.874458 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 231/472] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:17:27 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1793 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:17:28.271622 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:28.272131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:28.279120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:28.279597 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:28.280029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:28.280744 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:28.281192 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:28.281609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:28.417411 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:28.425396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c595b726-7dc0-4111-b5ef-71a7a853cf23 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.157929 Aug 09 19:17:28.425967 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 242/473] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:28 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:28.737388 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:28.738014 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:28.745238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:28.745739 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:28.746223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:28.746953 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:28.747439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:28.747860 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:28.882088 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:28.890192 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-074cf1c4-d218-42f2-9a64-511c4b57ebd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.156843 Aug 09 19:17:28.890764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 232/474] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:28 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:29.446976 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:29.447580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:29.454106 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:29.454584 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:29.455013 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:29.455693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:29.456140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:29.456590 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:29.589789 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:29.597264 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f9c07643-67b4-470c-8d8e-056764e4c6c9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.154211 Aug 09 19:17:29.597825 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 243/475] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:29 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:29.911523 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:29.912133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:29.918973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:29.919459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:29.919895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:29.920621 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:29.921080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:29.921504 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:29.924367 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:29.945969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=6 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:30.055089 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:30.062998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0b20fcd2-2a91-4318-909a-c2f07e01bae5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.155380 Aug 09 19:17:30.063563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 233/476] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:29 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:30.618554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:30.619161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:30.621124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:30.626724 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:30.627207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:30.627637 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:30.628319 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:30.628808 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:30.629228 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:30.760605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:30.768249 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-857fc9db-5708-4374-9d23-19dfeae01092 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.154186 Aug 09 19:17:30.768915 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 244/477] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:30 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:31.085583 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:31.086197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:31.093606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:31.094092 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:31.094533 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:31.095224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:31.095685 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:31.096110 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:31.228309 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:31.236263 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ec94d09f-893e-4747-8431-b9aeae6790ba tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.154567 Aug 09 19:17:31.236857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 234/478] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:31 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:17:31.789507 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:31.790209 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:31.792498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=76 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:31.798071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:31.798550 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:31.798969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:31.799651 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:31.800097 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:31.800536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:31.937451 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:31.945003 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2f89e664-7e8c-4b70-89fd-64a236294f71 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.159521 Aug 09 19:17:31.945574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 245/479] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:31 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:32.257441 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:32.258215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:32.265237 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:32.265724 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:32.266166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:32.266850 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:32.267470 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:32.267905 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:32.396147 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:32.404921 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6072548d-5a7a-4fb6-9b06-0b3a5e642d91 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.151676 Aug 09 19:17:32.405503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 235/480] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:32 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:32.967212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:32.967845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:32.974810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:32.975296 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:32.975729 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:32.976421 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:32.977108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:32.977531 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:33.120929 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:33.128698 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a342fe08-91f9-43ba-8626-45d5cc200339 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.166087 Aug 09 19:17:33.129258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 246/481] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:32 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:33.427079 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:33.427688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:33.434760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:33.435241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:33.435681 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:33.436372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:33.437242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:33.437671 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:33.566951 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:33.574833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a8465a35-237e-419f-91f6-5119c5fa58ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.151930 Aug 09 19:17:33.575386 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 236/482] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:33 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:34.158501 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:34.159095 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:34.165727 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:34.166201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:34.166630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:34.167315 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:34.167792 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:34.168206 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:34.306213 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:34.313680 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-45485edd-2797-4712-9fa4-b098043657bd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.167317 Aug 09 19:17:34.314259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 247/483] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:34 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:34.595260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:34.595787 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:34.602466 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:34.602949 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:34.603384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:34.604074 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:34.604559 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:34.604984 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:34.735223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:34.744126 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a279f736-4937-42a8-97e4-8d08137a0116 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.152874 Aug 09 19:17:34.744725 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 237/484] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:34 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:35.335332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:35.335979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:35.342463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:35.342978 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:35.343414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:35.344112 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:35.344605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:35.345033 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:35.474490 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:35.482481 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2cb75029-97fc-42c6-bbb9-3eddd28aa757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.151632 Aug 09 19:17:35.483042 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 248/485] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:35 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:35.765803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:35.766419 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:35.773892 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:35.774381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:35.774823 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:35.775538 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:35.775973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:35.776406 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:35.906920 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:35.915524 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-06c4a619-b50b-4169-b8c0-e19849eae329 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.153643 Aug 09 19:17:35.916090 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 238/486] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:35 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:36.503684 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:36.504292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:36.510965 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:36.511444 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:36.511874 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:36.512593 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:36.513045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:36.513463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:36.654621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:36.662005 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e8f6dc44-9003-4f32-a1fd-aaa37f1ba977 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.162233 Aug 09 19:17:36.662574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 249/487] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:36 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:36.938149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:36.938780 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:36.944747 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:36.945424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:36.945854 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:36.946541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:36.947011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:36.947429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:37.082124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:37.091141 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b38dbeb0-8e73-4404-8fe0-92cbf283b46d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1723 microversion: 2.1 time: 0.157310 Aug 09 19:17:37.091910 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 239/488] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:36 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:37.350114 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d73342da-2543-47ae-a0f9-8677da6afa1f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21b87f4d-7ba4-49d9-98e2-2a91c1fbb45d"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:37.352745 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d73342da-2543-47ae-a0f9-8677da6afa1f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:37.358672 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d73342da-2543-47ae-a0f9-8677da6afa1f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:37.359161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d73342da-2543-47ae-a0f9-8677da6afa1f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:37.359593 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d73342da-2543-47ae-a0f9-8677da6afa1f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:37.360305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d73342da-2543-47ae-a0f9-8677da6afa1f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:37.360801 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d73342da-2543-47ae-a0f9-8677da6afa1f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:37.361222 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d73342da-2543-47ae-a0f9-8677da6afa1f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:37.599221 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d73342da-2543-47ae-a0f9-8677da6afa1f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252931 Aug 09 19:17:37.599904 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 250/489] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:17:37 2022] POST /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:37.683939 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:37.684576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:37.692498 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:37.692498 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:37.692498 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:37.692498 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:37.692855 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:37.693035 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:37.826360 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:37.833860 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c4d463bb-cb46-451d-9053-6a63932a7d52 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.153714 Aug 09 19:17:37.834429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 240/490] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:37 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:38.114348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:38.115069 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:38.122535 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:38.123024 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:38.123514 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:38.124309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:38.124812 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:38.125238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:38.278646 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:38.289152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1399b6de-fe2d-4e93-b1cb-07250aeb27ed tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1700 microversion: 2.1 time: 0.179167 Aug 09 19:17:38.289768 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 251/491] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:38 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1700 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:38.310310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5687730a-56b3-43d2-9297-1d8668af3cd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:38.316641 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5687730a-56b3-43d2-9297-1d8668af3cd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:38.317122 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5687730a-56b3-43d2-9297-1d8668af3cd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:38.317551 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5687730a-56b3-43d2-9297-1d8668af3cd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:38.341113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5687730a-56b3-43d2-9297-1d8668af3cd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Going to try to start instance {{(pid=117822) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 19:17:38.358340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=100 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:38.382624 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5687730a-56b3-43d2-9297-1d8668af3cd4 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.075925 Aug 09 19:17:38.383250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 241/492] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:17:38 2022] POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:17:38.391463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:38.392076 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:38.398901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:38.399329 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:38.399756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:38.400670 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:38.401141 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:38.401647 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:38.589826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:38.598535 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-93db59fa-a3f9-4d03-b3b8-1a4598ae6f6e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1709 microversion: 2.1 time: 0.210815 Aug 09 19:17:38.599118 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 252/493] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:38 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1709 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:38.854918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:38.855612 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:38.862401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:38.862958 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:38.863521 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:38.864320 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:38.864864 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:38.865353 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:39.013501 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:39.021145 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-558052a9-d7e5-4902-914c-99381a8719f9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.170770 Aug 09 19:17:39.021709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 242/494] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:38 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:39.622819 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:39.623355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:39.629740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:39.630218 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:39.630648 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:39.631330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:39.631778 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:39.632353 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:39.767772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:39.776826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-751a3cad-7ac1-4976-9d06-d9c81e90d164 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1709 microversion: 2.1 time: 0.157959 Aug 09 19:17:39.777392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 253/495] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:39 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:40.043753 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:40.044400 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:40.051215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:40.051693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:40.052125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:40.052841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:40.053291 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:40.053835 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:40.188795 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:40.197707 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4db450e4-b17d-485d-a137-612fce6a7f9d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.157740 Aug 09 19:17:40.198222 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 243/496] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:40 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:40.799783 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:40.800396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:40.807689 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:40.808176 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:40.808717 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:40.809415 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:40.809866 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:40.810290 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:40.947235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:40.955262 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-263325e8-9909-4096-bbb5-ca7a6f8af72b tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1709 microversion: 2.1 time: 0.159886 Aug 09 19:17:40.955821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 254/497] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:40 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:41.086817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-ae5d70e2-1bd1-4d67-9dea-f6f4f28b76ec req-b2f8d714-84b1-4aa0-a040-dc695c6c2b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c627b1d-06ef-4702-9080-ee169c06437e", "name": "network-vif-plugged", "status": "completed", "tag": "1d0cc0a5-e01b-4194-b532-bc2554cfbc71"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:41.098396 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-ae5d70e2-1bd1-4d67-9dea-f6f4f28b76ec req-b2f8d714-84b1-4aa0-a040-dc695c6c2b65 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:41.098882 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-ae5d70e2-1bd1-4d67-9dea-f6f4f28b76ec req-b2f8d714-84b1-4aa0-a040-dc695c6c2b65 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:41.099315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-ae5d70e2-1bd1-4d67-9dea-f6f4f28b76ec req-b2f8d714-84b1-4aa0-a040-dc695c6c2b65 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:41.111001 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-ae5d70e2-1bd1-4d67-9dea-f6f4f28b76ec req-b2f8d714-84b1-4aa0-a040-dc695c6c2b65 service nova] Creating event network-vif-plugged:1d0cc0a5-e01b-4194-b532-bc2554cfbc71 for instance 1c627b1d-06ef-4702-9080-ee169c06437e on hv-cinder-85265 Aug 09 19:17:41.115712 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-ae5d70e2-1bd1-4d67-9dea-f6f4f28b76ec req-b2f8d714-84b1-4aa0-a040-dc695c6c2b65 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032732 Aug 09 19:17:41.116957 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 244/498] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:41.219174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:41.219786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:41.226369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:41.226862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:41.228559 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:41.229405 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:41.229873 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:41.230297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:41.234653 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:41.372657 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:41.380035 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-981da334-9964-4345-b977-8584f5e2e4df tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.164738 Aug 09 19:17:41.380698 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 255/499] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:41 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:41.498673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:41.499259 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:41.507052 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:41.507813 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:41.508253 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:41.508989 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:41.509582 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:41.510014 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:41.648651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lazy-loading 'services' on Instance uuid 6d4c8440-6012-4bb7-bec2-449fd00524dd {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:17:41.763299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8942b616-8b6b-4c80-b69d-18a5a3dcb403 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd/os-volume_attachments/1d273a07-53ca-49a6-85e1-b41e3ce9082b" status: 202 len: 0 microversion: 2.1 time: 0.268660 Aug 09 19:17:41.763885 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 245/500] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:17:41 2022] DELETE /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd/os-volume_attachments/1d273a07-53ca-49a6-85e1-b41e3ce9082b => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:17:41.977254 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:41.977887 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:41.984384 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:41.984888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:41.985311 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:41.986029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:41.986654 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:41.987070 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:42.115960 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:42.124155 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-9036da06-b378-47ab-b0aa-a79049fc1b15 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1713 microversion: 2.1 time: 0.151608 Aug 09 19:17:42.124751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 256/501] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:41 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1713 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:42.402665 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:42.403380 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:42.410049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:42.410534 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:42.410967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:42.411654 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:42.412110 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:42.412563 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:42.549069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:42.556375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-93f2bfbd-7298-4d72-84b2-9ccb1af2ecc9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1266 microversion: 2.1 time: 0.159546 Aug 09 19:17:42.556952 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 246/502] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:42 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:43.577738 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:43.578370 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:43.585273 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:43.585883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:43.586322 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:43.587019 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:43.587463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:43.587881 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:43.726549 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:43.734114 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7ec20067-5da1-4fee-80b3-cb4845fa78fd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1454 microversion: 2.1 time: 0.160283 Aug 09 19:17:43.734678 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 257/503] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:43 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:43.754955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:43.755559 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:43.762608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:43.763085 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:43.763512 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:43.764196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:43.764706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:43.765126 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:43.902605 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:43.910073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d22bde4e-0348-4b03-b174-5c0a5e85c227 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1454 microversion: 2.1 time: 0.158865 Aug 09 19:17:43.910653 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 247/504] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:43 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:45.192974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:45.196502 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:45.204422 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:45.204944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:45.205387 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:45.206094 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:45.206545 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:45.206962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:45.234282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lazy-loading 'flavor' on Instance uuid 62cf279d-dd85-42fc-93c9-4fc91e972306 {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:17:45.363593 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0570885b-f5c6-421d-a0a0-b73a3ee03186 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/action" status: 200 len: 32 microversion: 2.1 time: 0.175659 Aug 09 19:17:45.364268 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 258/505] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:17:45 2022] POST /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:17:45.374693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:45.375354 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:45.382825 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:45.383374 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:45.383824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:45.385938 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:45.386868 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:45.387313 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:45.530979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:45.539772 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ecaf084b-4fa8-427b-8611-dc16c72885ff tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.168984 Aug 09 19:17:45.540347 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 248/506] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:45 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:45.840397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-c421c5d2-acc4-45d8-bc48-c8183479f4f2 req-9ac18785-4069-415a-85ab-3b3c52a18dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c627b1d-06ef-4702-9080-ee169c06437e", "tag": "1d0cc0a5-e01b-4194-b532-bc2554cfbc71"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:45.851668 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c421c5d2-acc4-45d8-bc48-c8183479f4f2 req-9ac18785-4069-415a-85ab-3b3c52a18dd7 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:45.852179 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c421c5d2-acc4-45d8-bc48-c8183479f4f2 req-9ac18785-4069-415a-85ab-3b3c52a18dd7 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:45.852649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c421c5d2-acc4-45d8-bc48-c8183479f4f2 req-9ac18785-4069-415a-85ab-3b3c52a18dd7 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:45.865095 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-c421c5d2-acc4-45d8-bc48-c8183479f4f2 req-9ac18785-4069-415a-85ab-3b3c52a18dd7 service nova] Creating event network-changed:1d0cc0a5-e01b-4194-b532-bc2554cfbc71 for instance 1c627b1d-06ef-4702-9080-ee169c06437e on hv-cinder-85265 Aug 09 19:17:45.871748 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-c421c5d2-acc4-45d8-bc48-c8183479f4f2 req-9ac18785-4069-415a-85ab-3b3c52a18dd7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035690 Aug 09 19:17:45.872780 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 259/507] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:46.069887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:46.070495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:46.077071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:46.077901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:46.078530 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:46.079450 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:46.080106 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:46.080758 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:46.110726 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:17:46.240499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5964713c-3468-4876-9db9-2bac6d838ed3 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 204 len: 0 microversion: 2.1 time: 0.173496 Aug 09 19:17:46.244832 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 249/508] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:17:46 2022] DELETE /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:17:46.252559 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:46.253261 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:46.260405 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:46.260906 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:46.261332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:46.262021 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:46.262466 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:46.262878 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:46.427719 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:46.436794 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-42956941-126a-4b7e-a324-cd1526dbae30 tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1513 microversion: 2.1 time: 0.189915 Aug 09 19:17:46.437473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 260/509] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:46 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:46.562815 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:46.563576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:46.569899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:46.570382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:46.570808 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:46.571558 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:46.572012 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:46.572430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:46.710528 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:46.718831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f42f113b-e475-4e28-9278-4ae030828f98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.160294 Aug 09 19:17:46.719667 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 250/510] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:46 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:47.458185 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:47.458786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:47.465915 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:47.466403 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:47.466818 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:47.467492 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:47.467933 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:47.468345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:47.599319 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:47.606742 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-37f39131-874c-48a4-a785-82f75ff3424e tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1513 microversion: 2.1 time: 0.152383 Aug 09 19:17:47.607306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 261/511] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:47 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:47.740550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:47.741613 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:47.747861 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:47.748736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:47.749244 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:47.750268 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:47.750829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:47.751321 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:47.944801 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:47.952911 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-04280267-3215-488e-8609-7f15ec756363 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.216099 Aug 09 19:17:47.953475 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 251/512] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:47 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:48.550627 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-7d21220a-6017-451b-82e0-6cd76b170227 req-f3f7322c-ae25-4f09-9204-5efc1320db51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d4c8440-6012-4bb7-bec2-449fd00524dd", "name": "network-vif-deleted", "tag": "09db18c3-10c7-48df-9fca-42b6a06d9732"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:17:48.562534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-7d21220a-6017-451b-82e0-6cd76b170227 req-f3f7322c-ae25-4f09-9204-5efc1320db51 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:48.563000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-7d21220a-6017-451b-82e0-6cd76b170227 req-f3f7322c-ae25-4f09-9204-5efc1320db51 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:48.563471 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-7d21220a-6017-451b-82e0-6cd76b170227 req-f3f7322c-ae25-4f09-9204-5efc1320db51 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:48.574766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-7d21220a-6017-451b-82e0-6cd76b170227 req-f3f7322c-ae25-4f09-9204-5efc1320db51 service nova] Creating event network-vif-deleted:09db18c3-10c7-48df-9fca-42b6a06d9732 for instance 6d4c8440-6012-4bb7-bec2-449fd00524dd on hv-cinder-85265 Aug 09 19:17:48.582557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-7d21220a-6017-451b-82e0-6cd76b170227 req-f3f7322c-ae25-4f09-9204-5efc1320db51 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035965 Aug 09 19:17:48.584766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 262/513] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:17:48.627208 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:48.627846 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:48.634793 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:48.635202 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:48.635673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:48.636788 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:48.637430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:48.637994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:48.671831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:48.672594 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:48.673032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:48.673630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lazy-loading 'fault' on Instance uuid 6d4c8440-6012-4bb7-bec2-449fd00524dd {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:17:48.718713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871ff162be0b43c98b531e860f6a02e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a9557289ea4fe9903f6cf421d937d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:48.727207 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bff3f836-b01d-4aa3-b2ad-3427554be09c tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 200 len: 1308 microversion: 2.1 time: 0.103834 Aug 09 19:17:48.727782 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 252/514] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:48 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:17:48.975108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:48.975942 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:48.982220 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:48.982697 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:48.983124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:48.983822 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:48.984285 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:48.984705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:49.126292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:49.134751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3b5bb2c6-a35f-4166-aba4-01c0e3fc425d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.164296 Aug 09 19:17:49.135324 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 263/515] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:48 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:49.750940 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:49.751527 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] [instance: 6d4c8440-6012-4bb7-bec2-449fd00524dd] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:49.758226 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:49.758702 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:49.759131 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:49.759806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:49.760248 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:49.760701 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:49.774873 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] HTTP exception thrown: Instance 6d4c8440-6012-4bb7-bec2-449fd00524dd could not be found. Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Request method failure captured: Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd HTTP/1.1 Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rJBw2UlnKpLsrOqmV5I6Zr-sM7msPBmkxNSFfsvmUrTbf2WqA02hJZMMeEfrYojbRCOalg3ky-bITu_2ZYtKtbhBRxkY15PndK3EfKCWjbZG2juS8UfpBkMY68x9SPeMqlzToTi5jBUWVDxkFxRzWEnr9Hj_iVY58oLWLu9Mtw--I4 Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 37a9557289ea4fe9903f6cf421d937d1 Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1119513580 Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:17:49.776531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37a9557289ea4fe9903f6cf421d937d1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/37a9557289ea4fe9903f6cf421d937d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/37a9557289ea4fe9903f6cf421d937d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_37a9557289ea4fe9903f6cf421d937d1"}]}] Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesSnapshotTestJSON-1119513580 Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 37a9557289ea4fe9903f6cf421d937d1 Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1119513580 Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesSnapshotTestJSON-1119513580-project Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 871ff162be0b43c98b531e860f6a02e5 Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesSnapshotTestJSON-1119513580-project Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 6d4c8440-6012-4bb7-bec2-449fd00524dd could not be found. Aug 09 19:17:49.778338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '6d4c8440-6012-4bb7-bec2-449fd00524dd'} Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d4c8440-6012-4bb7-bec2-449fd00524dd could not be found. Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:17:49.779414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d4c8440-6012-4bb7-bec2-449fd00524dd could not be found. Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d4c8440-6012-4bb7-bec2-449fd00524dd could not be found. Aug 09 19:17:49.780934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:17:49.782302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] Returning 404 to user: Instance 6d4c8440-6012-4bb7-bec2-449fd00524dd could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:17:49.782302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1b3c3b2a-f00b-4a0f-a4ff-22fb0cd4205a tempest-VolumesSnapshotTestJSON-1119513580 tempest-VolumesSnapshotTestJSON-1119513580-project] 10.222.0.70 "GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd" status: 404 len: 111 microversion: 2.1 time: 0.030829 Aug 09 19:17:49.782302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 253/516] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:49 2022] GET /compute/v2.1/servers/6d4c8440-6012-4bb7-bec2-449fd00524dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:17:50.155904 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:50.156553 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:50.163040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:50.163514 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:50.163952 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:50.164716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:50.165172 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:50.165599 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:50.300781 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:50.309891 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6821851f-9315-4833-8d09-0939f237310f tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.157897 Aug 09 19:17:50.310468 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 264/517] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:50 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:51.331735 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:51.332348 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:51.339114 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:51.339598 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:51.340039 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:51.340891 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:51.341211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:51.341631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:51.473672 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:51.482235 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-10e6c809-29ea-4578-abba-42fae56ca418 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.154462 Aug 09 19:17:51.482799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 254/518] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:51 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:52.503068 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:52.503718 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:52.511304 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:52.511783 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:52.512220 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:52.512956 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:52.513409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:52.513831 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:52.645963 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:52.654470 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d3ceb732-7b80-45c7-8a4a-a4469180148c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.155253 Aug 09 19:17:52.655037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 265/519] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:52 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:53.675439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:53.676047 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:53.682583 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:53.683058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:53.683485 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:53.684196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:53.684681 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:53.685099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:53.815168 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:53.823677 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-69236594-afe9-4d6d-8c88-6b89bdd24e98 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.152352 Aug 09 19:17:53.824242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 255/520] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:53 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:54.845164 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:54.845910 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:54.853154 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:54.853633 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:54.854064 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:54.854753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:54.855201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:54.855621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:54.987395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:54.997185 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-56f67458-a362-4717-9510-e5b0f5f2d66c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.155867 Aug 09 19:17:54.998000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 266/521] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:54 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:56.019605 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:56.020121 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:56.027724 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:56.028271 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:56.028735 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:56.029430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:56.029939 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:56.030360 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:56.052237 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=3 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:56.168722 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:56.176944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-62b926fe-472b-405c-9ba1-3258981bc3d9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.161617 Aug 09 19:17:56.177513 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 256/522] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:56 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:57.200537 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:57.201303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:57.208248 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:57.208871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:57.210113 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:57.210912 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:57.211457 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:57.211972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:57.348661 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:57.356703 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4d8fb292-e5b2-4875-a0c1-e20d85fdacd5 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.160681 Aug 09 19:17:57.357274 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 267/523] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:57 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:58.378375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:58.379187 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:58.381340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:17:58.395906 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:58.396410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:58.396878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:58.397589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:58.398040 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:58.398452 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:58.543191 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:58.551973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3cfe296a-f10e-401c-9542-3e5506cdcc4d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.178001 Aug 09 19:17:58.552633 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 257/524] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:58 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:17:59.573270 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:17:59.573878 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:17:59.580352 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:59.580915 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:59.581356 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:59.582041 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:17:59.582489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:17:59.583674 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:17:59.718587 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:17:59.727349 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1f14c8f6-7281-4ee0-9ad5-049da14f19bb tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.158665 Aug 09 19:17:59.727923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 268/525] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:17:59 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:00.748095 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:00.748728 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:00.754898 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:00.755379 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:00.755816 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:00.757367 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:00.757998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:00.758429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:00.886246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:00.894405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ac143e4a-6984-4284-a5d1-6787d8cde284 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.150139 Aug 09 19:18:00.894998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 258/526] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:00 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:01.915529 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:01.916138 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:01.918644 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=48 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:01.924288 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:01.924791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:01.925225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:01.925910 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:01.926357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:01.926776 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:02.056872 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:02.064869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d6a590c3-ee5f-4146-8107-a6aa0137e12e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.153536 Aug 09 19:18:02.065439 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 269/527] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:01 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:03.086412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:03.086942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:03.094031 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:03.094503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:03.094969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:03.095648 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:03.096094 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:03.096548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:03.230076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:03.238225 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bc3f9238-5e0e-47b1-8b7a-a5cf219ff6cf tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.156010 Aug 09 19:18:03.238897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 259/528] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:03 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:04.261370 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:04.261949 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:04.268414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:04.268943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:04.269370 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:04.270047 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:04.270491 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:04.270969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:04.411798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:04.420457 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e2b5cbac-062f-423c-91cf-07eede311912 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.163760 Aug 09 19:18:04.421152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 270/529] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:04 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:05.442956 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:05.443556 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:05.449949 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:05.450425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:05.450855 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:05.451538 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:05.451981 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:05.452396 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:05.580173 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:05.589078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-61ae893d-e7cf-468e-b8af-8862ac0b23c8 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1736 microversion: 2.1 time: 0.149979 Aug 09 19:18:05.589645 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 260/530] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:05 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:06.610141 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:06.610772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:06.618656 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:06.619277 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:06.619858 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:06.620785 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:06.621346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:06.621773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:06.626453 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:06.754909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:06.763501 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d9a094f0-b636-43fd-aa5d-464c576100d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1716 microversion: 2.1 time: 0.157391 Aug 09 19:18:06.764071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 271/531] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:06 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:06.871176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:06.872326 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:06.878977 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:06.879466 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:06.879901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:06.880626 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:06.881080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:06.882357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:06.966435 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] HTTP exception thrown: Cannot 'detach_volume' instance 62cf279d-dd85-42fc-93c9-4fc91e972306 while it is in vm_state rescued Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Request method failure captured: Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments/21b87f4d-7ba4-49d9-98e2-2a91c1fbb45d HTTP/1.1 Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH3PlQVzEuZp387bTiBC5IV-2rAoCHSptdv8F5GdriAd-02z-mfqZPuvHtdE3J4PjFbt0AGaEoD4LVGFS_Qgy6Iw96aRVYRM8ZYFuZMcbO5eFGETiY1bW3sfSo5A0XbvTlEf8vqy83vaYVpRZa_x5dExriEkiuGg0GLTcK7ZnCXYfs Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:18:06.968137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/375ce88986dc47b08134e076562eee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_375ce88986dc47b08134e076562eee05"}]}] Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 8755b16a18734175b691f891351d5116 Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:18:06.969698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Cannot 'detach_volume' instance 62cf279d-dd85-42fc-93c9-4fc91e972306 while it is in vm_state rescued Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'server_id': '62cf279d-dd85-42fc-93c9-4fc91e972306', 'id': '21b87f4d-7ba4-49d9-98e2-2a91c1fbb45d'} Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62cf279d-dd85-42fc-93c9-4fc91e972306 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:18:06.970607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 62cf279d-dd85-42fc-93c9-4fc91e972306 while it is in vm_state rescued Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 62cf279d-dd85-42fc-93c9-4fc91e972306 while it is in vm_state rescued Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:06.973426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Returning 409 to user: Cannot 'detach_volume' instance 62cf279d-dd85-42fc-93c9-4fc91e972306 while it is in vm_state rescued {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:18:06.974631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-14d0d39a-1c57-4c66-9c12-2e2d30c310a0 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "DELETE /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments/21b87f4d-7ba4-49d9-98e2-2a91c1fbb45d" status: 409 len: 152 microversion: 2.1 time: 0.102808 Aug 09 19:18:06.974631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 261/532] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:18:06 2022] DELETE /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments/21b87f4d-7ba4-49d9-98e2-2a91c1fbb45d => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 19:18:06.980494 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-61c05f56-dcdd-4b7b-961c-fc3ad1fd97fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:06.981038 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-61c05f56-dcdd-4b7b-961c-fc3ad1fd97fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:06.987914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61c05f56-dcdd-4b7b-961c-fc3ad1fd97fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:06.988389 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61c05f56-dcdd-4b7b-961c-fc3ad1fd97fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:06.988848 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61c05f56-dcdd-4b7b-961c-fc3ad1fd97fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:06.989528 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61c05f56-dcdd-4b7b-961c-fc3ad1fd97fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:06.989968 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61c05f56-dcdd-4b7b-961c-fc3ad1fd97fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:06.990420 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61c05f56-dcdd-4b7b-961c-fc3ad1fd97fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:07.064365 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-61c05f56-dcdd-4b7b-961c-fc3ad1fd97fc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "POST /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/action" status: 202 len: 0 microversion: 2.1 time: 0.087991 Aug 09 19:18:07.065110 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 272/533] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:18:06 2022] POST /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 19:18:07.073384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:07.073985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:07.080036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:07.080553 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:07.080979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:07.081666 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:07.082110 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:07.082526 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:07.224738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:07.232976 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0c8f9d10-9f0f-4500-a2e3-fa3b62a6e197 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1724 microversion: 2.1 time: 0.163482 Aug 09 19:18:07.233544 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 262/534] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:07 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:08.255171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:08.255858 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:08.262308 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:08.262974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:08.263442 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:08.264129 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:08.264613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:08.265036 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:08.401146 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:08.409235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1a8db134-11b4-4cba-bccb-cb5be020bb16 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1724 microversion: 2.1 time: 0.158785 Aug 09 19:18:08.409801 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 273/535] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:08 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:09.431115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:09.431711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:09.438118 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:09.438597 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:09.439022 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:09.439701 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:09.440145 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:09.440588 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:09.571342 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:09.579340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1acf13e7-d94c-4b8a-a685-a00f56c38be7 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1724 microversion: 2.1 time: 0.152865 Aug 09 19:18:09.579913 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 263/536] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:09 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:10.601844 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:10.602399 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:10.608829 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:10.609313 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:10.609755 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:10.610441 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:10.610893 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:10.611319 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:10.746768 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:10.754733 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-55583c1c-00e8-40d6-941d-b17bab2e33da tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1730 microversion: 2.1 time: 0.157741 Aug 09 19:18:10.755300 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 274/537] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:10 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:10.775267 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f9ecf5d0-6f2e-42bc-b86e-f81a1f7649d2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:10.775801 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f9ecf5d0-6f2e-42bc-b86e-f81a1f7649d2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:10.782151 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f9ecf5d0-6f2e-42bc-b86e-f81a1f7649d2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:10.782625 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f9ecf5d0-6f2e-42bc-b86e-f81a1f7649d2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:10.783050 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f9ecf5d0-6f2e-42bc-b86e-f81a1f7649d2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:10.783728 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f9ecf5d0-6f2e-42bc-b86e-f81a1f7649d2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:10.784171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f9ecf5d0-6f2e-42bc-b86e-f81a1f7649d2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:10.784631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f9ecf5d0-6f2e-42bc-b86e-f81a1f7649d2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:10.861674 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f9ecf5d0-6f2e-42bc-b86e-f81a1f7649d2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090695 Aug 09 19:18:10.862262 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 264/538] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Aug 9 19:18:10 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:18:11.744544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-222313e6-e60f-408a-92e8-2cce61336c88 req-83d5ab75-468f-47cb-b42a-e76a91c8ecb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cf279d-dd85-42fc-93c9-4fc91e972306", "tag": "cddca46a-78ca-473b-b9f0-e1a051f447e5"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:11.754782 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-222313e6-e60f-408a-92e8-2cce61336c88 req-83d5ab75-468f-47cb-b42a-e76a91c8ecb0 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:11.755551 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-222313e6-e60f-408a-92e8-2cce61336c88 req-83d5ab75-468f-47cb-b42a-e76a91c8ecb0 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:11.755985 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-222313e6-e60f-408a-92e8-2cce61336c88 req-83d5ab75-468f-47cb-b42a-e76a91c8ecb0 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:11.771866 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-222313e6-e60f-408a-92e8-2cce61336c88 req-83d5ab75-468f-47cb-b42a-e76a91c8ecb0 service nova] Creating event network-changed:cddca46a-78ca-473b-b9f0-e1a051f447e5 for instance 62cf279d-dd85-42fc-93c9-4fc91e972306 on hv-cinder-85265 Aug 09 19:18:11.779033 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-222313e6-e60f-408a-92e8-2cce61336c88 req-83d5ab75-468f-47cb-b42a-e76a91c8ecb0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039318 Aug 09 19:18:11.779641 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 275/539] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:13.797606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-d98fee2a-83c0-434e-abbe-0a5a53a85365 req-f54c73e6-7a35-41ae-8174-7034a52c12df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62cf279d-dd85-42fc-93c9-4fc91e972306", "tag": "cddca46a-78ca-473b-b9f0-e1a051f447e5"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:13.807471 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-d98fee2a-83c0-434e-abbe-0a5a53a85365 req-f54c73e6-7a35-41ae-8174-7034a52c12df service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:13.807950 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-d98fee2a-83c0-434e-abbe-0a5a53a85365 req-f54c73e6-7a35-41ae-8174-7034a52c12df service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:13.808381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-d98fee2a-83c0-434e-abbe-0a5a53a85365 req-f54c73e6-7a35-41ae-8174-7034a52c12df service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:13.820591 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-d98fee2a-83c0-434e-abbe-0a5a53a85365 req-f54c73e6-7a35-41ae-8174-7034a52c12df service nova] Creating event network-changed:cddca46a-78ca-473b-b9f0-e1a051f447e5 for instance 62cf279d-dd85-42fc-93c9-4fc91e972306 on hv-cinder-85265 Aug 09 19:18:13.825704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-d98fee2a-83c0-434e-abbe-0a5a53a85365 req-f54c73e6-7a35-41ae-8174-7034a52c12df service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034461 Aug 09 19:18:13.826635 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 265/540] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:15.833517 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-62d5d1a1-43a4-4cc9-97c6-8f67bbc35233 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:15.834115 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-62d5d1a1-43a4-4cc9-97c6-8f67bbc35233 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:15.841108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a1-43a4-4cc9-97c6-8f67bbc35233 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:15.841520 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a1-43a4-4cc9-97c6-8f67bbc35233 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:15.841950 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a1-43a4-4cc9-97c6-8f67bbc35233 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:15.842731 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a1-43a4-4cc9-97c6-8f67bbc35233 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:15.843181 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a1-43a4-4cc9-97c6-8f67bbc35233 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:15.843595 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62d5d1a1-43a4-4cc9-97c6-8f67bbc35233 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:15.875241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-62d5d1a1-43a4-4cc9-97c6-8f67bbc35233 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments/ddfb7900-93ee-4c57-b976-f3d4d9e7417f" status: 200 len: 194 microversion: 2.20 time: 0.046771 Aug 09 19:18:15.876183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 276/541] 10.222.0.70 () {60 vars in 1454 bytes} [Tue Aug 9 19:18:15 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments/ddfb7900-93ee-4c57-b976-f3d4d9e7417f => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:18:15.960595 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:15.961182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:15.968266 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:15.968794 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:15.969531 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:15.970658 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:15.971285 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:15.971933 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:16.091668 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lazy-loading 'services' on Instance uuid b5249124-ef8d-4931-8114-ad85549b447c {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:18:16.178164 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-efe7323b-5030-4841-8cce-cac2d6fc98eb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments/ddfb7900-93ee-4c57-b976-f3d4d9e7417f" status: 202 len: 0 microversion: 2.20 time: 0.220979 Aug 09 19:18:16.179876 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 266/542] 10.222.0.70 () {60 vars in 1457 bytes} [Tue Aug 9 19:18:15 2022] DELETE /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments/ddfb7900-93ee-4c57-b976-f3d4d9e7417f => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:18:16.190396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3fc5a558-1675-4871-921e-68f0f778210c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:16.194381 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3fc5a558-1675-4871-921e-68f0f778210c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:16.204672 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fc5a558-1675-4871-921e-68f0f778210c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:16.205310 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fc5a558-1675-4871-921e-68f0f778210c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:16.205849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fc5a558-1675-4871-921e-68f0f778210c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:16.206660 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fc5a558-1675-4871-921e-68f0f778210c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:16.207214 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fc5a558-1675-4871-921e-68f0f778210c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:16.207784 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fc5a558-1675-4871-921e-68f0f778210c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:16.281296 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3fc5a558-1675-4871-921e-68f0f778210c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096631 Aug 09 19:18:16.282284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 277/543] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Aug 9 19:18:16 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 19:18:17.298698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-26469ce4-2ad3-4a4d-a47a-3994d13de722 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:17.302238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-26469ce4-2ad3-4a4d-a47a-3994d13de722 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:17.327805 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-26469ce4-2ad3-4a4d-a47a-3994d13de722 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:17.330022 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-26469ce4-2ad3-4a4d-a47a-3994d13de722 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:17.331166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-26469ce4-2ad3-4a4d-a47a-3994d13de722 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:17.332224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-26469ce4-2ad3-4a4d-a47a-3994d13de722 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:17.333646 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-26469ce4-2ad3-4a4d-a47a-3994d13de722 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:17.334833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-26469ce4-2ad3-4a4d-a47a-3994d13de722 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:17.385432 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-26469ce4-2ad3-4a4d-a47a-3994d13de722 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.092739 Aug 09 19:18:17.395049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 267/544] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Aug 9 19:18:17 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:17.468926 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:17.469402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:17.476773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:17.477253 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:17.477670 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:17.478360 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:17.478802 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:17.479215 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:17.505471 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:18:17.603017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4cdae48e-ee7d-463c-ace8-dd95f5a00916 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 204 len: 0 microversion: 2.20 time: 0.137802 Aug 09 19:18:17.603896 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 278/545] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Aug 9 19:18:17 2022] DELETE /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 19:18:17.612392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:17.613447 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:17.620733 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:17.621260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:17.621686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:17.622569 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:17.623163 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:17.623584 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:17.893810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:17.907340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:17.909339 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:17.910877 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0c01c43a-aceb-4fda-99f9-93cbb4b4d0bc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.302509 Aug 09 19:18:17.911941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 268/546] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:17 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:18:18.936960 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:18.938017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:18.945780 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:18.946287 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:18.946835 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:18.947753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:18.948371 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:18.948823 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:19.114681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:19.128221 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:19.130474 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:19.134911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8fca01db-068a-452b-be33-39249e15677c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1721 microversion: 2.20 time: 0.202765 Aug 09 19:18:19.135847 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 279/547] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:18 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:20.159744 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:20.161063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:20.168967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:20.169755 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:20.170372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:20.171104 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:20.171727 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:20.172606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:20.274009 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:20.287170 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:20.288850 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:20.290488 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d00909b9-0d04-46c6-9332-72b22deae619 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 200 len: 1654 microversion: 2.20 time: 0.134768 Aug 09 19:18:20.291255 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 269/548] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:20 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 1654 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:20.579664 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-2580a958-e4bc-4b25-b404-ff8d38d358da req-7108c65e-75d0-4bab-85b7-d292391d9f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5249124-ef8d-4931-8114-ad85549b447c", "name": "network-vif-deleted", "tag": "02edcf89-39d2-4084-b64b-2b2ce84d06d8"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:20.597167 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-2580a958-e4bc-4b25-b404-ff8d38d358da req-7108c65e-75d0-4bab-85b7-d292391d9f69 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:20.597914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-2580a958-e4bc-4b25-b404-ff8d38d358da req-7108c65e-75d0-4bab-85b7-d292391d9f69 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:20.598549 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-2580a958-e4bc-4b25-b404-ff8d38d358da req-7108c65e-75d0-4bab-85b7-d292391d9f69 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:20.639184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-2580a958-e4bc-4b25-b404-ff8d38d358da req-7108c65e-75d0-4bab-85b7-d292391d9f69 service nova] Creating event network-vif-deleted:02edcf89-39d2-4084-b64b-2b2ce84d06d8 for instance b5249124-ef8d-4931-8114-ad85549b447c on hv-cinder-85265 Aug 09 19:18:20.660194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-2580a958-e4bc-4b25-b404-ff8d38d358da req-7108c65e-75d0-4bab-85b7-d292391d9f69 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084962 Aug 09 19:18:20.663426 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 280/549] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:21.332157 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:21.333870 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:21.403385 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:21.409754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:21.410395 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:21.411297 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:21.411978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:21.413864 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:21.439723 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] HTTP exception thrown: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Request method failure captured: Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c HTTP/1.1 Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH3RAkVgVMSVVaIu7eK7sCdz77IAUIop4EWyIkgtdZcutPLENgtR9N8qzuJacT35DlKDOeLNdE2p0C79ljhXCDltrs4hgCPehYbhNMY6jxTvELATcuolLZWZ9lgco8xoq-Pd8D5n9wXdu7u5sQHBZbbStRZOCmxNfwMh8235aVW1qA Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:18:21.441922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b32d5c45c614fd08a57af6be1143590"}]}] Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: e9ad80a549b14b25ac71cd96832a74e7 Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:18:21.443738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'b5249124-ef8d-4931-8114-ad85549b447c'} Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:18:21.444676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:18:21.446144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:21.448272 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Returning 404 to user: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:18:21.449790 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-704dc359-c9bc-47d7-b2c5-380fb4ed99e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 404 len: 111 microversion: 2.20 time: 0.135746 Aug 09 19:18:21.450705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 270/550] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:21 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:18:21.481726 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5bb2b172-5233-457e-8d47-80747379a242 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '.version_select at 0x7fa508170790>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:21.520361 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5bb2b172-5233-457e-8d47-80747379a242 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-182124585" status: 204 len: 0 microversion: 2.20 time: 0.064549 Aug 09 19:18:21.529555 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 281/551] 10.222.0.70 () {60 vars in 1259 bytes} [Tue Aug 9 19:18:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-182124585 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 19:18:22.658026 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3ca91955-c3ba-41d1-8206-ce66b38ce1bb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'create', calling method: .version_select at 0x7fa50371b9d0>, body: {"keypair": {"name": "tempest-keypair-1626533613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDutjiODCqIbUWjzpeeB7iJErBRmEw9cYeGNYQlWu94P1Rn+XI0lzsCPpL6bIgHzh/mdXyZTfn6WnKh88FIHaFtV1wQJJ6r+nMiFJYR9+1KKz0hZXdx9oJyK4hG/gr/fCw=="}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:22.717916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-3ca91955-c3ba-41d1-8206-ce66b38ce1bb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Getting quotas for project 8b32d5c45c614fd08a57af6be1143590. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:18:22.739185 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-3ca91955-c3ba-41d1-8206-ce66b38ce1bb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Getting quotas for user e9ad80a549b14b25ac71cd96832a74e7 and project 8b32d5c45c614fd08a57af6be1143590. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:18:22.799430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3ca91955-c3ba-41d1-8206-ce66b38ce1bb tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.146188 Aug 09 19:18:22.806450 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 271/552] 10.222.0.70 () {62 vars in 1200 bytes} [Tue Aug 9 19:18:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 19:18:23.874726 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:23.882024 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:23.915907 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:23.918124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:23.919281 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:23.924490 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:23.925208 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:23.927049 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:24.087673 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lazy-loading 'services' on Instance uuid ab83633d-a2ac-4257-b317-ed1894b0fd8d {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:18:24.292793 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7752473d-37fb-469b-86a3-83648f3fb8a5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/os-volume_attachments/014dbb3d-62dc-409e-b421-35adcf086287" status: 202 len: 0 microversion: 2.1 time: 0.423170 Aug 09 19:18:24.294257 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 282/553] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:18:23 2022] DELETE /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/os-volume_attachments/014dbb3d-62dc-409e-b421-35adcf086287 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:18:25.151428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2136000208", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8832d330-8087-426c-a906-c4c5d0f4010e"}], "security_groups": [{"name": "tempest-securitygroup--1946289852"}], "key_name": "tempest-keypair-1626533613", "user_data": "}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:25.286411 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] validate_networks() for [('8832d330-8087-426c-a906-c4c5d0f4010e', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:18:25.567697 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6934af18-b2e0-4a83-887f-8c00637fb4db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:25.576842 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6934af18-b2e0-4a83-887f-8c00637fb4db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:25.578954 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6934af18-b2e0-4a83-887f-8c00637fb4db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:25.579560 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6934af18-b2e0-4a83-887f-8c00637fb4db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:25.654649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6934af18-b2e0-4a83-887f-8c00637fb4db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Going to try to stop instance {{(pid=117823) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 19:18:25.730437 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6934af18-b2e0-4a83-887f-8c00637fb4db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.166517 Aug 09 19:18:25.733843 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 283/554] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:18:25 2022] POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 19:18:25.743400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:25.744363 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:25.753576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:25.754965 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:25.755569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:25.756608 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:25.757433 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:25.758604 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:25.927122 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:18:25.927539 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:18:25.928055 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:18:25.928591 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:18:25.928886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:18:25.939258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:25.940025 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:25.940691 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:25.941580 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:25.941884 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:25.947059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:25.959871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:25.968622 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-24aa352e-7ad1-488f-b113-68f5c1ff5314 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1677 microversion: 2.1 time: 0.229864 Aug 09 19:18:25.969210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 284/555] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:25 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:25.981444 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Getting quotas for project 8b32d5c45c614fd08a57af6be1143590. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:18:25.989259 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Getting quotas for user e9ad80a549b14b25ac71cd96832a74e7 and project 8b32d5c45c614fd08a57af6be1143590. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:18:26.002182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:18:26.005165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:18:26.064113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-44698274-8fd0-4d6f-bc4d-65577c9c0e29 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.919461 Aug 09 19:18:26.064817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 272/556] 10.222.0.70 () {62 vars in 1188 bytes} [Tue Aug 9 19:18:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 19:18:26.076336 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-77fbce03-9d14-4cb7-a007-b9b85bcaa4d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:26.076970 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-77fbce03-9d14-4cb7-a007-b9b85bcaa4d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:26.163713 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-77fbce03-9d14-4cb7-a007-b9b85bcaa4d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:26.172873 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-77fbce03-9d14-4cb7-a007-b9b85bcaa4d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:26.175129 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-77fbce03-9d14-4cb7-a007-b9b85bcaa4d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:26.176699 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-77fbce03-9d14-4cb7-a007-b9b85bcaa4d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1282 microversion: 2.20 time: 0.104187 Aug 09 19:18:26.177751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 285/557] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:26 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:18:26.994559 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:26.995753 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:27.002797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:27.003282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:27.008694 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:27.009764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:27.010384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:27.010983 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:27.017138 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:27.202573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:27.203804 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:27.218026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:27.219288 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:27.221210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:27.222105 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:27.222557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:27.222976 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:27.231827 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:27.239572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-19d229ec-cc89-47b2-a9d6-75314de5a385 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1677 microversion: 2.1 time: 0.250116 Aug 09 19:18:27.240077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 273/558] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:26 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1677 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:27.311553 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:27.315381 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:27.320698 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:27.322212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:27.323332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-dc9c1dbe-6584-44df-91d3-516fc6ab38e5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1334 microversion: 2.20 time: 0.124861 Aug 09 19:18:27.325471 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 286/559] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:27 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1334 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:28.265426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:28.266643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:28.274547 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:28.275128 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:28.275906 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:28.276757 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:28.277287 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:28.277789 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:28.350816 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:28.351739 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:28.366728 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:28.367527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:28.371391 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:28.372559 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:28.373230 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:28.373883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:28.504164 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:28.516111 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-15c839c3-e78d-4086-8824-164fda82590e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1677 microversion: 2.1 time: 0.254589 Aug 09 19:18:28.518937 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 274/560] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:28 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:28.746763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:28.756295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:28.758128 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:28.759425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2ef4b707-4794-4876-9a7c-9df3542afd7f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1408 microversion: 2.20 time: 0.413442 Aug 09 19:18:28.760149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 287/561] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:28 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1408 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:18:29.245505 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-7aa3163a-cec2-45cc-9abf-00b2e8d85a67 req-0b4d1726-e411-4296-8859-493715c028a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fa3b0c-4952-4132-9fae-7b242fb393f5", "tag": "422e722d-30ec-4f63-8a1b-d4c21996173d"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:29.252568 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:29.289294 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7aa3163a-cec2-45cc-9abf-00b2e8d85a67 req-0b4d1726-e411-4296-8859-493715c028a9 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:29.289881 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7aa3163a-cec2-45cc-9abf-00b2e8d85a67 req-0b4d1726-e411-4296-8859-493715c028a9 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:29.290128 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7aa3163a-cec2-45cc-9abf-00b2e8d85a67 req-0b4d1726-e411-4296-8859-493715c028a9 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:29.327585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-7aa3163a-cec2-45cc-9abf-00b2e8d85a67 req-0b4d1726-e411-4296-8859-493715c028a9 service nova] Creating event network-changed:422e722d-30ec-4f63-8a1b-d4c21996173d for instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 on hv-cinder-85265 Aug 09 19:18:29.349087 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-7aa3163a-cec2-45cc-9abf-00b2e8d85a67 req-0b4d1726-e411-4296-8859-493715c028a9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107086 Aug 09 19:18:29.350272 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 275/562] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:29.540134 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:29.543435 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:29.553496 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:29.554360 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:29.555015 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:29.556005 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:29.556730 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:29.557388 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:29.784632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:29.785556 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:29.796296 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:29.798055 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:29.799136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:29.800021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:29.801170 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:29.802246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:29.872788 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:29.889089 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d1946a66-cb34-4026-9a52-4d9acb3c679f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1677 microversion: 2.1 time: 0.353575 Aug 09 19:18:29.889968 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 288/563] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:29 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1677 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:30.038152 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:30.052113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:30.054948 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:30.056707 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-cff91a78-6a85-4dbd-8dd3-78978eb83259 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1408 microversion: 2.20 time: 0.277287 Aug 09 19:18:30.058245 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 276/564] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:29 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:30.913418 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:30.914294 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:30.927306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:30.928520 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:30.929210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:30.930128 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:30.930826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:30.931508 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:31.079608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:31.081098 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:31.089311 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:31.096199 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:31.099503 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:31.101355 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:31.106117 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:31.106842 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:31.355410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:31.364202 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:31.372696 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:31.379076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-099e38e5-33c7-4e61-8d8c-8bdd56eeacc5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1408 microversion: 2.20 time: 0.303310 Aug 09 19:18:31.380260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 277/565] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:31 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:31.422929 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:31.436005 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-06a3d31f-5598-4908-88a7-fe18026cd0eb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1677 microversion: 2.1 time: 0.527170 Aug 09 19:18:31.437396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 289/566] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:30 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1677 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:32.402561 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:32.403171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:32.412117 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:32.412888 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:32.413515 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:32.417372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:32.418194 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:32.418813 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:32.463357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:32.464059 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:32.474327 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:32.476681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:32.477174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:32.477609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:32.483446 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:32.483984 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:32.484424 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:32.581518 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:32.590912 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:32.592527 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:32.593723 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-34bb57dd-ac1e-455c-9b5d-15c48b17722f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1408 microversion: 2.20 time: 0.195095 Aug 09 19:18:32.612612 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 278/567] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:32 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:32.663901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:32.676192 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2cf2deba-5e5a-4466-8280-01fdaa63ad52 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1677 microversion: 2.1 time: 0.219780 Aug 09 19:18:32.676947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 290/568] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:32 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:33.619152 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:33.619670 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:33.627835 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:33.628319 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:33.628958 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:33.629833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:33.630577 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:33.631743 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:33.720562 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:33.721453 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:33.733571 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:33.735738 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:33.736277 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:33.739014 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:33.739540 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:33.740859 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:33.906708 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:33.920642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-00412068-948e-4f01-8b6e-5c18c42f12fd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1677 microversion: 2.1 time: 0.204997 Aug 09 19:18:33.921617 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 291/569] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:33 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1677 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:34.095413 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:34.104607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:34.106115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:34.107435 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c7ad2e64-e030-429d-aa32-f877813327d2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1408 microversion: 2.20 time: 0.492553 Aug 09 19:18:34.108159 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 279/570] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:33 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1408 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:34.943978 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:34.944734 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:34.951855 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:34.952601 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:34.953195 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:34.954064 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:34.954718 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:34.955325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:35.105980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:35.115182 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-714e7229-69ac-46e8-9cf0-8d05e72e3302 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1677 microversion: 2.1 time: 0.174924 Aug 09 19:18:35.116783 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 292/571] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:34 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:35.133788 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:35.134549 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:35.141179 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:35.141896 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:35.142328 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:35.143012 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:35.143454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:35.143871 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:35.310704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:35.322363 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:35.324180 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:35.325835 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1d825ebb-02f1-4cda-a0b4-d7187bbfc17f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1408 microversion: 2.20 time: 0.195940 Aug 09 19:18:35.341378 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 280/572] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:35 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:35.364035 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-848c1b46-1b04-4b99-a2f1-a0a54acc2d6e req-227e6352-53e9-4fc1-b7e8-d3286d3e1551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fa3b0c-4952-4132-9fae-7b242fb393f5", "name": "network-vif-plugged", "status": "completed", "tag": "422e722d-30ec-4f63-8a1b-d4c21996173d"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:35.381394 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-848c1b46-1b04-4b99-a2f1-a0a54acc2d6e req-227e6352-53e9-4fc1-b7e8-d3286d3e1551 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:35.381394 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-848c1b46-1b04-4b99-a2f1-a0a54acc2d6e req-227e6352-53e9-4fc1-b7e8-d3286d3e1551 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:35.381394 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-848c1b46-1b04-4b99-a2f1-a0a54acc2d6e req-227e6352-53e9-4fc1-b7e8-d3286d3e1551 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:35.395390 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-848c1b46-1b04-4b99-a2f1-a0a54acc2d6e req-227e6352-53e9-4fc1-b7e8-d3286d3e1551 service nova] Creating event network-vif-plugged:422e722d-30ec-4f63-8a1b-d4c21996173d for instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 on hv-cinder-85265 Aug 09 19:18:35.432809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-848c1b46-1b04-4b99-a2f1-a0a54acc2d6e req-227e6352-53e9-4fc1-b7e8-d3286d3e1551 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072275 Aug 09 19:18:35.433882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 293/573] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:36.011514 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b7643bb8-deb1-48ee-a416-c4648291c0e1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Action: 'create', calling method: .version_select at 0x7fa50372c700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-935185389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlaNDOXhF2OLSt3kXI2Qf5ry3/Tq86k6h1jvTL7wEdRCt1Nyja6/RRaygREiDuLCrZg5Z9ZXkURb4F8hwV36JjG5/pLVpJhk6TJV+TdrqqjMOnXsMDn4PyAIhdeFhZ+cA=="}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:36.017056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:36.017723 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=10 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:36.030534 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-b7643bb8-deb1-48ee-a416-c4648291c0e1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Getting quotas for project 63c5b147e9d0494381a36bd407f110db. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:18:36.034465 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-b7643bb8-deb1-48ee-a416-c4648291c0e1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Getting quotas for user cbec728603924ccabfffc6cc8d18c5c9 and project 63c5b147e9d0494381a36bd407f110db. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:18:36.057980 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b7643bb8-deb1-48ee-a416-c4648291c0e1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.050455 Aug 09 19:18:36.058792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 281/574] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:18:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:36.128810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1736464340", "imageRef": "9f10d5b8-b086-4959-90c9-0cc998248a85", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-935185389", "networks": [{"uuid": "403d288e-23be-480b-a43a-331f16e6cb6f"}]}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:36.137243 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:36.137855 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:36.144242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:36.144760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:36.145195 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:36.145888 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:36.146375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:36.146798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:36.170807 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:36.184566 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] validate_networks() for [('403d288e-23be-480b-a43a-331f16e6cb6f', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:18:36.283649 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:36.291981 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9c03a81c-d4d5-46e9-8b77-3c22b93882ea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1654 microversion: 2.1 time: 0.158518 Aug 09 19:18:36.292578 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 282/575] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:36 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1654 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:36.312608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0a2a00af-1697-40ce-b987-92b5cb69f01e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:36.319375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0a2a00af-1697-40ce-b987-92b5cb69f01e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:36.319974 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0a2a00af-1697-40ce-b987-92b5cb69f01e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:36.320406 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0a2a00af-1697-40ce-b987-92b5cb69f01e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:36.343499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0a2a00af-1697-40ce-b987-92b5cb69f01e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Going to try to start instance {{(pid=117822) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 19:18:36.385880 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0a2a00af-1697-40ce-b987-92b5cb69f01e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.076859 Aug 09 19:18:36.386982 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 283/576] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:18:36 2022] POST /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 19:18:36.392397 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:36.393711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:36.400763 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:36.401281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:36.401717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:36.402421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:36.402866 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:36.403315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:36.553868 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:36.562993 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:36.564522 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:36.565636 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-54e21fab-6309-4dba-a67a-b5431359b653 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1408 microversion: 2.20 time: 0.177310 Aug 09 19:18:36.566190 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 284/577] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:36 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:36.571345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:36.571944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:36.577860 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:36.578335 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:36.578762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:36.579443 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:36.579887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:36.580394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:36.594984 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:18:36.595539 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:18:36.596214 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:18:36.596928 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:18:36.597496 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:18:36.607508 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:36.608292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:36.610961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:36.610961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:36.610961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:36.610961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:36.633974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Getting quotas for project 63c5b147e9d0494381a36bd407f110db. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:18:36.639060 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Getting quotas for user cbec728603924ccabfffc6cc8d18c5c9 and project 63c5b147e9d0494381a36bd407f110db. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:18:36.651965 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:18:36.654608 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9f10d5b8-b086-4959-90c9-0cc998248a85',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:18:36.703422 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-26a9a6a9-a5ba-4e8a-8e85-de95cef6a341 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579346 Aug 09 19:18:36.709537 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 294/578] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:18:36.717420 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-51557241-9b57-4d5c-b5ff-dfadad9872c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:36.718331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-51557241-9b57-4d5c-b5ff-dfadad9872c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:36.751797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:36.761618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2cd4ead7-7ee4-40c8-90c2-f33c9bb0e324 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1663 microversion: 2.1 time: 0.194373 Aug 09 19:18:36.777070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 285/579] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:36 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1663 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:36.797461 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-51557241-9b57-4d5c-b5ff-dfadad9872c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:36.805479 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-51557241-9b57-4d5c-b5ff-dfadad9872c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1258 microversion: 2.1 time: 0.093052 Aug 09 19:18:36.806049 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 295/580] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:36 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:37.588599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:37.589208 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:37.595658 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:37.596193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:37.596658 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:37.597403 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:37.597914 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:37.598279 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:37.730695 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:37.738693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:37.740854 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:37.742728 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-80083749-240f-4536-a581-d1d51b56bb24 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1599 microversion: 2.20 time: 0.157608 Aug 09 19:18:37.742831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 286/581] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:18:37 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:18:37.764908 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b65699c8-e47e-4539-b97c-5998220667dc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:37.765408 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b65699c8-e47e-4539-b97c-5998220667dc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:37.772466 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b65699c8-e47e-4539-b97c-5998220667dc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:37.772954 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b65699c8-e47e-4539-b97c-5998220667dc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:37.773393 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b65699c8-e47e-4539-b97c-5998220667dc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:37.774082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b65699c8-e47e-4539-b97c-5998220667dc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:37.774572 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b65699c8-e47e-4539-b97c-5998220667dc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:37.774994 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b65699c8-e47e-4539-b97c-5998220667dc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:37.782839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:37.783444 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:37.790325 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:37.790811 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:37.791254 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:37.793639 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:37.794103 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:37.794532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:37.907793 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b65699c8-e47e-4539-b97c-5998220667dc tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146667 Aug 09 19:18:37.908915 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 296/582] 10.222.0.70 () {60 vars in 1316 bytes} [Tue Aug 9 19:18:37 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:18:37.922491 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:37.923290 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:37.933101 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:37.933825 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:37.934527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:37.935385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:37.936019 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:37.936846 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:38.006415 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:38.016962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-fac69ede-fc48-425b-9c99-bb32937c03f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1318 microversion: 2.1 time: 0.097951 Aug 09 19:18:38.017926 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 297/583] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:37 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:38.097611 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:38.106809 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-448f43bf-e68d-49a1-b3e6-eff15ce98fd9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1663 microversion: 2.1 time: 0.327573 Aug 09 19:18:38.108366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 287/584] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:37 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1663 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:39.039243 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:39.039904 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:39.054695 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:39.055140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:39.055577 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:39.056366 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:39.056847 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:39.057271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:39.132145 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:39.137279 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:39.148105 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:39.150091 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:39.150596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:39.156730 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:39.156969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e1a00e80-f07f-403b-9929-fde4ff6c75c7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1316 microversion: 2.1 time: 0.122620 Aug 09 19:18:39.157752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:39.160488 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 298/585] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:39 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1316 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:39.160631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:39.160631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:39.548887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:39.563213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e70cc827-7ecb-49d2-a1c5-dadd1eb17140 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1663 microversion: 2.1 time: 0.433784 Aug 09 19:18:39.565720 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 288/586] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:39 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1663 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:39.767642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-4c2776d9-b678-4f2e-8104-e763e1bbf071 req-7cd7016b-f75d-4642-b8bb-3e67f6299acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2fa3b0c-4952-4132-9fae-7b242fb393f5", "tag": "422e722d-30ec-4f63-8a1b-d4c21996173d"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:39.797841 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4c2776d9-b678-4f2e-8104-e763e1bbf071 req-7cd7016b-f75d-4642-b8bb-3e67f6299acf service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:39.798488 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4c2776d9-b678-4f2e-8104-e763e1bbf071 req-7cd7016b-f75d-4642-b8bb-3e67f6299acf service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:39.799038 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4c2776d9-b678-4f2e-8104-e763e1bbf071 req-7cd7016b-f75d-4642-b8bb-3e67f6299acf service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:39.816844 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-4c2776d9-b678-4f2e-8104-e763e1bbf071 req-7cd7016b-f75d-4642-b8bb-3e67f6299acf service nova] Creating event network-changed:422e722d-30ec-4f63-8a1b-d4c21996173d for instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 on hv-cinder-85265 Aug 09 19:18:39.829750 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-4c2776d9-b678-4f2e-8104-e763e1bbf071 req-7cd7016b-f75d-4642-b8bb-3e67f6299acf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065773 Aug 09 19:18:39.830981 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 299/587] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:40.180689 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:40.181379 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:40.188901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:40.189705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:40.190337 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:40.191250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:40.191886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:40.192924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:40.365082 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:40.374188 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-59ba404a-80d9-4cf9-8de2-e54b1fc3f170 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.197421 Aug 09 19:18:40.375620 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 289/588] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:40 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:40.591320 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:40.592667 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:40.612840 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:40.613436 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:40.613909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:40.614671 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:40.615714 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:40.616357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:40.783715 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:40.798459 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a65971d8-c0ec-479d-b575-e74c4365c1a3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1663 microversion: 2.1 time: 0.212703 Aug 09 19:18:40.815772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 300/589] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:40 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1663 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:41.404829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:41.405583 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:41.413496 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:41.413978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:41.414407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:41.415098 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:41.415541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:41.415959 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:41.432130 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:41.561180 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:41.570037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c92dcd22-1d58-42e6-8604-671df74be1bf tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.170182 Aug 09 19:18:41.570766 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 290/590] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:41 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:41.822284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:41.822835 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:41.829601 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:41.830087 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:41.830708 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:41.831601 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:41.832061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:41.832613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:41.977694 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:41.986845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4fdf82a4-506e-409a-9b6c-ab4727454f60 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1663 microversion: 2.1 time: 0.169091 Aug 09 19:18:41.987548 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 301/591] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:41 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:42.592737 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:42.593341 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:42.600665 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:42.601150 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:42.601580 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:42.602453 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:42.603072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:42.603661 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:42.741687 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:42.749242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1905188d-92a4-4d71-9388-0e50914f3673 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.160471 Aug 09 19:18:42.749819 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 291/592] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:42 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:43.009703 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:43.010325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:43.016944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:43.017432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:43.017860 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:43.018564 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:43.019017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:43.019442 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:43.171047 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:43.180246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-12caeb37-771d-44d5-823a-0253e9692252 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1663 microversion: 2.1 time: 0.173974 Aug 09 19:18:43.180888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 302/593] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:43 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:43.772313 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:43.773130 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:43.779484 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:43.780057 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:43.780718 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:43.781504 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:43.782028 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:43.782520 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:43.923420 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:43.931281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1c8d52ba-b309-4592-8198-2b7866596279 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.163777 Aug 09 19:18:43.931873 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 292/594] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:43 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:44.202624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:44.203337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:44.210229 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:44.210713 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:44.211144 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:44.211841 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:44.212293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:44.212742 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:44.353302 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:44.361133 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-bf7f2eb4-35da-4003-ae45-1c8b6c4dfc8a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1663 microversion: 2.1 time: 0.162700 Aug 09 19:18:44.361720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 303/595] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:44 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1663 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:44.954427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:44.955071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:44.962328 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:44.962825 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:44.963254 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:44.963965 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:44.964393 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:44.964828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:45.107081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:45.115403 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d8ccd2f1-7d23-4570-b9a4-20c7e206bcf2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.164976 Aug 09 19:18:45.116002 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 293/596] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:44 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:45.383489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:45.384258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:45.391506 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:45.392074 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:45.392629 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:45.393410 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:45.393939 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:45.394602 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:45.540962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:45.549187 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5e23e73b-79d5-426d-84dc-8bed93469afa tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1663 microversion: 2.1 time: 0.169788 Aug 09 19:18:45.549772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 304/597] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:45 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:46.138122 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:46.138795 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:46.141424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=4 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:46.147928 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:46.148414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:46.149265 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:46.149971 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:46.150479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:46.150853 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:46.300390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:46.308604 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b45be574-ee15-4e05-8d07-b17c09a187bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.175130 Aug 09 19:18:46.309408 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 294/598] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:46 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:46.572100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:46.574079 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:46.581474 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:46.582194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:46.582894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:46.583732 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:46.584536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:46.585198 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:46.622770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:46.729834 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:46.737991 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-351652df-f3e5-45ca-8892-a3976c714eea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1663 microversion: 2.1 time: 0.171131 Aug 09 19:18:46.738572 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 305/599] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:46 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:47.330138 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:47.330729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:47.337303 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:47.337778 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:47.338234 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:47.338978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:47.339551 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:47.339971 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:47.472605 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:47.480477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8fcecaf5-a413-4946-ba8e-fe2d34bbe2d7 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.154189 Aug 09 19:18:47.481055 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 295/600] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:47 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:47.760992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:47.761761 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:47.763910 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=8 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:47.769841 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:47.770609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:47.771621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:47.772489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:47.773140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:47.773560 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:47.982590 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:47.986525 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:47.992961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-9425ab62-96d1-40e5-92b9-7c7a8f643ab3 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1667 microversion: 2.1 time: 0.237131 Aug 09 19:18:47.993641 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 306/601] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:47 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1667 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:48.220509 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-7f8ef94d-676a-40b7-a1ed-02133cbed812 req-8972d50e-258a-4058-807c-0cf47d0cfb6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a38bc60-9e78-4799-a3dc-b5d706eb4aa8", "tag": "7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:48.234070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7f8ef94d-676a-40b7-a1ed-02133cbed812 req-8972d50e-258a-4058-807c-0cf47d0cfb6a service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:48.234901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7f8ef94d-676a-40b7-a1ed-02133cbed812 req-8972d50e-258a-4058-807c-0cf47d0cfb6a service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:48.235695 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7f8ef94d-676a-40b7-a1ed-02133cbed812 req-8972d50e-258a-4058-807c-0cf47d0cfb6a service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:48.249582 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-7f8ef94d-676a-40b7-a1ed-02133cbed812 req-8972d50e-258a-4058-807c-0cf47d0cfb6a service nova] Creating event network-changed:7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df for instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 on hv-cinder-85265 Aug 09 19:18:48.255054 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-7f8ef94d-676a-40b7-a1ed-02133cbed812 req-8972d50e-258a-4058-807c-0cf47d0cfb6a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041473 Aug 09 19:18:48.257011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 296/602] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:48.503949 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:48.504615 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:48.510870 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:48.511348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:48.511782 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:48.512490 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:48.512942 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:48.513360 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:48.710071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:48.717818 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a200b9fe-c477-45e8-86c9-a55b335a4d34 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.218202 Aug 09 19:18:48.718394 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 307/603] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:48 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:49.745941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:49.745941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:49.752483 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:49.753089 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:49.753280 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:49.754392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:49.755856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:49.756001 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:49.882530 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:49.883896 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:49.890835 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:49.891709 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:49.892398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:49.893355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:49.894108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:49.894692 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:49.957135 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:49.965995 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e4bcada6-caf3-4356-9170-8cb3496e4c02 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.229395 Aug 09 19:18:49.972492 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 297/604] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:49 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:50.166025 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lazy-loading 'services' on Instance uuid 62cf279d-dd85-42fc-93c9-4fc91e972306 {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:18:50.246605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-98597879-6f4f-4b6d-ae10-59233b886a17 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "DELETE /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments/21b87f4d-7ba4-49d9-98e2-2a91c1fbb45d" status: 202 len: 0 microversion: 2.1 time: 0.368848 Aug 09 19:18:50.247329 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 308/605] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:18:49 2022] DELETE /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments/21b87f4d-7ba4-49d9-98e2-2a91c1fbb45d => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 19:18:50.261663 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-37df774c-6c8f-40c5-95d2-b8a70b6408bc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:50.265363 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-37df774c-6c8f-40c5-95d2-b8a70b6408bc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:50.272323 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-37df774c-6c8f-40c5-95d2-b8a70b6408bc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:50.272858 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-37df774c-6c8f-40c5-95d2-b8a70b6408bc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:50.273305 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-37df774c-6c8f-40c5-95d2-b8a70b6408bc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:50.274010 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-37df774c-6c8f-40c5-95d2-b8a70b6408bc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:50.274467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-37df774c-6c8f-40c5-95d2-b8a70b6408bc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:50.274890 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-37df774c-6c8f-40c5-95d2-b8a70b6408bc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:50.311250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-37df774c-6c8f-40c5-95d2-b8a70b6408bc tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057439 Aug 09 19:18:50.311941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 298/606] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:18:50 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:50.988176 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:50.988898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:50.995983 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:50.996492 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:50.996935 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:50.997623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:50.998074 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:50.998495 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:51.136001 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:51.143477 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4eb33941-bc01-4715-aaa6-b2472a45aa80 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.160041 Aug 09 19:18:51.144044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 309/607] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:50 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:51.323587 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1ad0eb1b-9e6c-4d0f-94a4-437c7fa25004 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:51.325782 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1ad0eb1b-9e6c-4d0f-94a4-437c7fa25004 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:51.332028 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad0eb1b-9e6c-4d0f-94a4-437c7fa25004 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:51.332715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad0eb1b-9e6c-4d0f-94a4-437c7fa25004 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:51.333150 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad0eb1b-9e6c-4d0f-94a4-437c7fa25004 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:51.333973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad0eb1b-9e6c-4d0f-94a4-437c7fa25004 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:51.334623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad0eb1b-9e6c-4d0f-94a4-437c7fa25004 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:51.335047 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad0eb1b-9e6c-4d0f-94a4-437c7fa25004 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:51.364161 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1ad0eb1b-9e6c-4d0f-94a4-437c7fa25004 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044500 Aug 09 19:18:51.365394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 299/608] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:18:51 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:18:51.443107 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:51.443691 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:51.449856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:51.450325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:51.450753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:51.451494 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:51.451932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:51.452354 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:51.479434 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:18:51.555901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4268f665-aaef-4131-9d7d-f05a47c56030 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "DELETE /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 204 len: 0 microversion: 2.1 time: 0.116686 Aug 09 19:18:51.556693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 310/609] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:18:51 2022] DELETE /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:18:51.564920 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:51.565532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:51.572321 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:51.572843 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:51.573282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:51.573974 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:51.574428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:51.574852 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:51.707116 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:51.714810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-657b5d89-3911-4826-9feb-1b1ad507429b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1690 microversion: 2.1 time: 0.153813 Aug 09 19:18:51.715381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 300/610] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:51 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:52.165222 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:52.165925 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:52.172773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:52.173248 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:52.173677 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:52.174357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:52.174805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:52.175221 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:52.311171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:52.319551 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3f0f4540-da94-4231-aabc-970c8d891f65 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.158752 Aug 09 19:18:52.320132 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 311/611] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:52 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:52.735922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:52.736639 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:52.743735 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:52.744215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:52.744676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:52.745394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:52.745845 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:52.746269 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:52.873072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:52.881491 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c515489b-8a03-47ab-a15c-fc0dffcae61d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1690 microversion: 2.1 time: 0.149328 Aug 09 19:18:52.882073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 301/612] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:52 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:53.340211 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:53.340925 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:53.347267 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:53.347968 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:53.348708 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:53.350333 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:53.351117 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:53.352217 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:53.414420 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-ac9e8fac-8038-4da6-968a-7ae713708214 req-70de9bb4-2111-4b76-857c-59b093c91fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a38bc60-9e78-4799-a3dc-b5d706eb4aa8", "name": "network-vif-plugged", "status": "completed", "tag": "7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:53.424586 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-ac9e8fac-8038-4da6-968a-7ae713708214 req-70de9bb4-2111-4b76-857c-59b093c91fe6 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:53.425115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-ac9e8fac-8038-4da6-968a-7ae713708214 req-70de9bb4-2111-4b76-857c-59b093c91fe6 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:53.425538 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-ac9e8fac-8038-4da6-968a-7ae713708214 req-70de9bb4-2111-4b76-857c-59b093c91fe6 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:53.438133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-ac9e8fac-8038-4da6-968a-7ae713708214 req-70de9bb4-2111-4b76-857c-59b093c91fe6 service nova] Creating event network-vif-plugged:7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df for instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 on hv-cinder-85265 Aug 09 19:18:53.443216 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-ac9e8fac-8038-4da6-968a-7ae713708214 req-70de9bb4-2111-4b76-857c-59b093c91fe6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033238 Aug 09 19:18:53.444095 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 302/613] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:18:53.492624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:53.500102 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a95640fa-3a99-4faa-aada-0da4bec40a10 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.163732 Aug 09 19:18:53.500703 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 312/614] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:53 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:53.902959 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:53.903654 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:53.910310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:53.910809 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:53.911242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:53.912684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:53.913141 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:53.913564 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:54.153319 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:54.161606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-07955894-29fd-4838-b7b7-df90e9102956 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1690 microversion: 2.1 time: 0.262671 Aug 09 19:18:54.162475 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 303/615] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:53 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:54.521766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:54.522300 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:54.528696 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:54.529175 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:54.529607 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:54.530293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:54.531244 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:54.531244 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:54.663169 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:54.670609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1c8e38c0-c828-4bdd-8973-5f62bdc29058 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.152913 Aug 09 19:18:54.671174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 313/616] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:54 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:55.186111 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:55.186713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:55.193982 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:55.194462 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:55.194893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:55.195620 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:55.196071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:55.196748 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:55.348709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:55.356220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c9050415-e982-46d0-83d3-6db6de4bbe0e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1690 microversion: 2.1 time: 0.174099 Aug 09 19:18:55.356815 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 304/617] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:55 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1690 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:55.692215 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:55.693026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:55.699578 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:55.700063 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:55.700519 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:55.701207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:55.701654 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:55.702074 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:55.847636 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:55.858907 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2f179e15-ec35-4491-97b3-ba17e5ee8146 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1358 microversion: 2.1 time: 0.170148 Aug 09 19:18:55.869882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 314/618] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:55 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:56.377388 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:56.377934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:56.385805 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:56.388939 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:56.389474 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:56.390146 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:56.390666 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:56.391110 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:56.615445 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:56.624208 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-437cff32-a8e6-4341-8969-dc7a11f95367 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1690 microversion: 2.1 time: 0.250819 Aug 09 19:18:56.624883 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 305/619] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:56 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1690 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:56.881956 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:56.883249 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:56.891771 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:56.892334 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:56.893178 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:56.893897 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:56.894427 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:56.894859 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.019756 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-1747c0ec-8f0c-401d-bf83-79f654d20ecf req-da19df80-55fe-4ae9-8789-b9f915cec14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62cf279d-dd85-42fc-93c9-4fc91e972306", "name": "network-vif-deleted", "tag": "cddca46a-78ca-473b-b9f0-e1a051f447e5"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:57.032853 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:57.036532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1747c0ec-8f0c-401d-bf83-79f654d20ecf req-da19df80-55fe-4ae9-8789-b9f915cec14e service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.037072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1747c0ec-8f0c-401d-bf83-79f654d20ecf req-da19df80-55fe-4ae9-8789-b9f915cec14e service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.037519 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1747c0ec-8f0c-401d-bf83-79f654d20ecf req-da19df80-55fe-4ae9-8789-b9f915cec14e service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.045586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2d4ec8a2-6f08-4ffa-9311-e1841a8c13d5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1548 microversion: 2.1 time: 0.168314 Aug 09 19:18:57.046182 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 315/620] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:56 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:57.050097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-1747c0ec-8f0c-401d-bf83-79f654d20ecf req-da19df80-55fe-4ae9-8789-b9f915cec14e service nova] Creating event network-vif-deleted:cddca46a-78ca-473b-b9f0-e1a051f447e5 for instance 62cf279d-dd85-42fc-93c9-4fc91e972306 on hv-cinder-85265 Aug 09 19:18:57.055651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-1747c0ec-8f0c-401d-bf83-79f654d20ecf req-da19df80-55fe-4ae9-8789-b9f915cec14e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039781 Aug 09 19:18:57.056507 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 306/621] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:57.068536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:57.069239 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:57.076622 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.077312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.077901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.078617 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.079104 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.080989 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.298168 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:57.308984 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4ebfbb3c-32dd-41b3-842e-19dfed28b263 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1548 microversion: 2.1 time: 0.244867 Aug 09 19:18:57.310183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 316/622] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:57 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:18:57.332928 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:57.341120 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:57.341884 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Searching by: {'deleted': False, 'project_id': '63c5b147e9d0494381a36bd407f110db'} {{(pid=117822) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 19:18:57.348972 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.349465 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.349890 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.350611 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.351059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.351479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.442171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.multi_cell_list [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117822) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 19:18:57.546147 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-503a2111-2e36-4b13-83d4-ca3ec1580adc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.218417 Aug 09 19:18:57.547406 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 307/623] 10.222.0.70 () {58 vars in 1125 bytes} [Tue Aug 9 19:18:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:18:57.559263 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:57.559988 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:57.566195 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.566774 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.567332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.569184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.569716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.570212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.647757 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:57.648689 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:57.662703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.663557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.665098 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.666006 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.666621 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.668040 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.707450 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:57.708249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:57.708923 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:57.709382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lazy-loading 'fault' on Instance uuid 62cf279d-dd85-42fc-93c9-4fc91e972306 {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:18:57.712874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=100 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:57.768749 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:57.779328 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-989bed16-302c-4d4c-b90a-8767057365c2 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 200 len: 1335 microversion: 2.1 time: 0.136151 Aug 09 19:18:57.788721 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 308/624] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:57 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 1335 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:57.849806 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:18:57.858868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-281946b4-fef6-43b2-8d00-81849418360c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1548 microversion: 2.1 time: 0.303779 Aug 09 19:18:57.859457 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 317/625] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:57 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1548 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:18:58.800527 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:58.801140 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 62cf279d-dd85-42fc-93c9-4fc91e972306] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:58.808143 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:58.808667 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:58.809101 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:58.809786 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:58.810236 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:58.810658 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:58.823781 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] HTTP exception thrown: Instance 62cf279d-dd85-42fc-93c9-4fc91e972306 could not be found. Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Request method failure captured: Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 HTTP/1.1 Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH3PlQVzEuZp387bTiBC5IV-2rAoCHSptdv8F5GdriAd-02z-mfqZPuvHtdE3J4PjFbt0AGaEoD4LVGFS_Qgy6Iw96aRVYRM8ZYFuZMcbO5eFGETiY1bW3sfSo5A0XbvTlEf8vqy83vaYVpRZa_x5dExriEkiuGg0GLTcK7ZnCXYfs Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:18:58.825429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/375ce88986dc47b08134e076562eee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_375ce88986dc47b08134e076562eee05"}]}] Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 8755b16a18734175b691f891351d5116 Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 62cf279d-dd85-42fc-93c9-4fc91e972306 could not be found. Aug 09 19:18:58.827033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '62cf279d-dd85-42fc-93c9-4fc91e972306'} Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62cf279d-dd85-42fc-93c9-4fc91e972306 could not be found. Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:18:58.828100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62cf279d-dd85-42fc-93c9-4fc91e972306 could not be found. Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62cf279d-dd85-42fc-93c9-4fc91e972306 could not be found. Aug 09 19:18:58.829798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:18:58.831147 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Returning 404 to user: Instance 62cf279d-dd85-42fc-93c9-4fc91e972306 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:18:58.831147 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e40f8b06-067f-44b3-9e58-a19c30a1278b tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306" status: 404 len: 111 microversion: 2.1 time: 0.030430 Aug 09 19:18:58.831147 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 309/626] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:18:58 2022] GET /compute/v2.1/servers/62cf279d-dd85-42fc-93c9-4fc91e972306 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:18:58.835577 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4516d743-d7d5-4841-90ea-422b4a343622 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '.version_select at 0x7fa5080943a0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:18:58.853889 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4516d743-d7d5-4841-90ea-422b4a343622 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458459783" status: 202 len: 0 microversion: 2.1 time: 0.022223 Aug 09 19:18:58.854439 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 318/627] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Aug 9 19:18:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458459783 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 19:18:59.585614 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b65ca59c-04c9-4aee-94c3-1348cc533235 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4929b3b6-f59f-47a0-a533-1b7b43f0b78f"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:18:59.587917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b65ca59c-04c9-4aee-94c3-1348cc533235 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:18:59.589939 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:18:59.595102 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b65ca59c-04c9-4aee-94c3-1348cc533235 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:59.595583 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b65ca59c-04c9-4aee-94c3-1348cc533235 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:59.596018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b65ca59c-04c9-4aee-94c3-1348cc533235 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:59.596742 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b65ca59c-04c9-4aee-94c3-1348cc533235 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:18:59.597195 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b65ca59c-04c9-4aee-94c3-1348cc533235 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:18:59.597617 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b65ca59c-04c9-4aee-94c3-1348cc533235 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:18:59.846108 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b65ca59c-04c9-4aee-94c3-1348cc533235 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "POST /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264858 Aug 09 19:18:59.846762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 310/628] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:18:59 2022] POST /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:19:01.839573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:01.840097 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:01.846450 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:01.846928 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:01.847364 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:01.848052 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:01.848527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:01.848948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:01.874535 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:19:01.946624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-222f959d-4f19-4fde-ba82-5be019df45a9 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "DELETE /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 204 len: 0 microversion: 2.1 time: 0.111252 Aug 09 19:19:01.947205 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 319/629] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:19:01 2022] DELETE /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:19:01.956310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:01.957123 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:01.964382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:01.964914 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:01.965352 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:01.966051 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:01.966505 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:01.966937 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:02.107078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:02.114797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-431c081a-78c0-4736-8c3e-5014116c88d1 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1507 microversion: 2.1 time: 0.163351 Aug 09 19:19:02.115394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 311/630] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:01 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:03.136395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:03.137045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:03.139445 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:03.145150 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:03.145623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:03.146051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:03.146887 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:03.147336 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:03.147752 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:03.166891 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:03.284572 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:03.292459 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4286530d-9f73-42e0-aec0-28a806fc17fd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1507 microversion: 2.1 time: 0.161003 Aug 09 19:19:03.293042 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 320/631] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:03 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:04.314483 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:04.315008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:04.322044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:04.322522 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:04.322980 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:04.323666 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:04.324114 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:04.324567 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:04.462709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:04.470254 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a98489ff-4529-4eb7-9d0d-631c49da604e tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1507 microversion: 2.1 time: 0.159796 Aug 09 19:19:04.470818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 312/632] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:04 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:04.942752 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-dbd6ae94-6ccf-4d9d-bb9a-20ecc5b9c4c1 req-69cf6887-65fb-4a8f-8575-3060b33bb662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39198df8-0086-49fa-9144-f42684a5513a", "name": "network-vif-deleted", "tag": "3b8e268c-bee6-4a6b-b29d-7f00e37ebbf0"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:04.954379 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-dbd6ae94-6ccf-4d9d-bb9a-20ecc5b9c4c1 req-69cf6887-65fb-4a8f-8575-3060b33bb662 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:04.954898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-dbd6ae94-6ccf-4d9d-bb9a-20ecc5b9c4c1 req-69cf6887-65fb-4a8f-8575-3060b33bb662 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:04.955332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-dbd6ae94-6ccf-4d9d-bb9a-20ecc5b9c4c1 req-69cf6887-65fb-4a8f-8575-3060b33bb662 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:04.968918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-dbd6ae94-6ccf-4d9d-bb9a-20ecc5b9c4c1 req-69cf6887-65fb-4a8f-8575-3060b33bb662 service nova] Creating event network-vif-deleted:3b8e268c-bee6-4a6b-b29d-7f00e37ebbf0 for instance 39198df8-0086-49fa-9144-f42684a5513a on hv-cinder-85265 Aug 09 19:19:04.974867 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-dbd6ae94-6ccf-4d9d-bb9a-20ecc5b9c4c1 req-69cf6887-65fb-4a8f-8575-3060b33bb662 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035692 Aug 09 19:19:04.975662 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 321/633] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:05.491204 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:05.491861 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:05.498215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:05.498688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:05.499114 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:05.499787 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:05.500229 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:05.500673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:05.530402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:05.530870 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:05.531295 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:05.531729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lazy-loading 'fault' on Instance uuid 39198df8-0086-49fa-9144-f42684a5513a {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:19:05.572925 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:05.580429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-97d18da8-d4e3-4ccc-a658-2077dfc70754 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 200 len: 1311 microversion: 2.1 time: 0.093268 Aug 09 19:19:05.581011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 313/634] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:05 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:06.377495 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:06.378218 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:06.385643 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:06.386056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:06.386489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:06.387175 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:06.387619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:06.388037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:06.520940 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:06.529580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6d3056de-8f7a-4524-82a1-5b7a3a199243 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1594 microversion: 2.1 time: 0.156258 Aug 09 19:19:06.530175 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 322/635] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:06 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:06.603097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:06.603930 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 39198df8-0086-49fa-9144-f42684a5513a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:06.610475 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:06.611028 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:06.611529 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:06.612306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:06.612848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:06.613338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:06.626811 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] HTTP exception thrown: Instance 39198df8-0086-49fa-9144-f42684a5513a could not be found. Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Request method failure captured: Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a HTTP/1.1 Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH3PlQVzEuZp387bTiBC5IV-2rAoCHSptdv8F5GdriAd-02z-mfqZPuvHtdE3J4PjFbt0AGaEoD4LVGFS_Qgy6Iw96aRVYRM8ZYFuZMcbO5eFGETiY1bW3sfSo5A0XbvTlEf8vqy83vaYVpRZa_x5dExriEkiuGg0GLTcK7ZnCXYfs Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:19:06.628472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/375ce88986dc47b08134e076562eee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_375ce88986dc47b08134e076562eee05"}]}] Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 8755b16a18734175b691f891351d5116 Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 39198df8-0086-49fa-9144-f42684a5513a could not be found. Aug 09 19:19:06.629796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '39198df8-0086-49fa-9144-f42684a5513a'} Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39198df8-0086-49fa-9144-f42684a5513a could not be found. Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:19:06.630603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39198df8-0086-49fa-9144-f42684a5513a could not be found. Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39198df8-0086-49fa-9144-f42684a5513a could not be found. Aug 09 19:19:06.631797 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:06.635290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Returning 404 to user: Instance 39198df8-0086-49fa-9144-f42684a5513a could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:19:06.635290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ea97005e-9f5e-4dba-86ec-3e6247326a71 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a" status: 404 len: 111 microversion: 2.1 time: 0.030710 Aug 09 19:19:06.635290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 314/636] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:06 2022] GET /compute/v2.1/servers/39198df8-0086-49fa-9144-f42684a5513a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:19:06.638972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:06.639476 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:06.645464 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:06.645941 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:06.646372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:06.647066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:06.647510 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:06.649311 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:06.674787 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:19:06.753929 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-db7ecaf4-f5f4-4df0-96f0-7ae68666880d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 204 len: 0 microversion: 2.1 time: 0.118207 Aug 09 19:19:06.754584 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 323/637] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:19:06 2022] DELETE /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:19:06.764249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:06.765323 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:06.771533 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:06.772022 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:06.772482 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:06.774026 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:06.774492 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:06.774954 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:06.920955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:06.929751 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-05839351-1a12-4a3f-a884-9171019e37ad tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.168975 Aug 09 19:19:06.930510 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 315/638] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:06 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:07.950832 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:07.951569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:07.962594 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:07.963320 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:07.963963 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:07.964887 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:07.965497 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:07.966091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:08.182158 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:08.190043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-43b0c340-7451-4002-b68b-44e95b394c8c tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.243392 Aug 09 19:19:08.190888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 324/639] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:07 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:08.305642 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-a53275fc-4f25-44ee-b650-88c023b24e34 req-72cbbcba-9fb7-4fc7-bd92-76bd0e6ee29d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a38bc60-9e78-4799-a3dc-b5d706eb4aa8", "tag": "7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:08.311727 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:08.316818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-a53275fc-4f25-44ee-b650-88c023b24e34 req-72cbbcba-9fb7-4fc7-bd92-76bd0e6ee29d service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:08.317296 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-a53275fc-4f25-44ee-b650-88c023b24e34 req-72cbbcba-9fb7-4fc7-bd92-76bd0e6ee29d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:08.317821 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-a53275fc-4f25-44ee-b650-88c023b24e34 req-72cbbcba-9fb7-4fc7-bd92-76bd0e6ee29d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:08.330172 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-a53275fc-4f25-44ee-b650-88c023b24e34 req-72cbbcba-9fb7-4fc7-bd92-76bd0e6ee29d service nova] Creating event network-changed:7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df for instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 on hv-cinder-85265 Aug 09 19:19:08.335740 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-a53275fc-4f25-44ee-b650-88c023b24e34 req-72cbbcba-9fb7-4fc7-bd92-76bd0e6ee29d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033299 Aug 09 19:19:08.336683 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 316/640] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:09.213718 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:09.214513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:09.221247 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:09.221871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:09.222407 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:09.223638 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:09.224231 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:09.225091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:09.256262 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-472142308"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:09.256262 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:09.264018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:09.264538 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:09.269008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:09.269886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:09.270562 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:09.271081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:09.396181 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:09.405169 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-002ca3c4-69a0-4cd2-978f-9a520a070127 tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.197425 Aug 09 19:19:09.406306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 325/641] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:09 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:09.436233 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.network.security_group_api [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Adding security group 6acffbf8-10e9-40c2-b237-9703ee4cf77b to port 7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df Aug 09 19:19:09.765926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ae81509c-94e3-44f2-9c12-b5cf656af9bd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "POST /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.515704 Aug 09 19:19:09.765926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 317/642] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:19:09 2022] POST /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:19:09.775676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-2908ae74-88a8-41bd-9076-638c958f645f req-5e4afe65-47a3-40bb-af41-1a5c46238f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a38bc60-9e78-4799-a3dc-b5d706eb4aa8", "tag": "7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:09.775911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:09.776355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:09.784116 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:09.784691 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:09.785115 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:09.785822 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:09.786273 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:09.786691 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:09.788314 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-2908ae74-88a8-41bd-9076-638c958f645f req-5e4afe65-47a3-40bb-af41-1a5c46238f33 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:09.789571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-2908ae74-88a8-41bd-9076-638c958f645f req-5e4afe65-47a3-40bb-af41-1a5c46238f33 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:09.790306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-2908ae74-88a8-41bd-9076-638c958f645f req-5e4afe65-47a3-40bb-af41-1a5c46238f33 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:09.805929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-2908ae74-88a8-41bd-9076-638c958f645f req-5e4afe65-47a3-40bb-af41-1a5c46238f33 service nova] Creating event network-changed:7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df for instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 on hv-cinder-85265 Aug 09 19:19:09.812433 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-2908ae74-88a8-41bd-9076-638c958f645f req-5e4afe65-47a3-40bb-af41-1a5c46238f33 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041109 Aug 09 19:19:09.813729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 318/643] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:09.942292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:09.951592 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-03ef826e-af0a-4622-a40e-6d3d5b9792b5 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1640 microversion: 2.1 time: 0.180598 Aug 09 19:19:09.952171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 326/644] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:09 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1640 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:10.429464 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:10.430561 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:10.437737 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:10.439190 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:10.439870 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:10.440839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:10.441508 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:10.442168 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:10.677880 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8755b16a18734175b691f891351d5116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375ce88986dc47b08134e076562eee05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:10.687518 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4b904720-90b5-40ac-8415-83a023038ddd tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 200 len: 1522 microversion: 2.1 time: 0.264128 Aug 09 19:19:10.688106 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 319/645] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:10 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:11.709684 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:11.711053 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] [instance: 5a736d74-42d3-4b24-b251-f869fbbefdaf] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:11.718513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:11.718998 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:11.719432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:11.720120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:11.720612 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:11.721039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:11.734830 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] HTTP exception thrown: Instance 5a736d74-42d3-4b24-b251-f869fbbefdaf could not be found. Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Request method failure captured: Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf HTTP/1.1 Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rH3PlQVzEuZp387bTiBC5IV-2rAoCHSptdv8F5GdriAd-02z-mfqZPuvHtdE3J4PjFbt0AGaEoD4LVGFS_Qgy6Iw96aRVYRM8ZYFuZMcbO5eFGETiY1bW3sfSo5A0XbvTlEf8vqy83vaYVpRZa_x5dExriEkiuGg0GLTcK7ZnCXYfs Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:19:11.736489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/375ce88986dc47b08134e076562eee05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/375ce88986dc47b08134e076562eee05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_375ce88986dc47b08134e076562eee05"}]}] Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 375ce88986dc47b08134e076562eee05 Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-593678341 Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 8755b16a18734175b691f891351d5116 Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-ServerRescueNegativeTestJSON-593678341-project Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance 5a736d74-42d3-4b24-b251-f869fbbefdaf could not be found. Aug 09 19:19:11.738037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': '5a736d74-42d3-4b24-b251-f869fbbefdaf'} Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a736d74-42d3-4b24-b251-f869fbbefdaf could not be found. Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:19:11.738756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a736d74-42d3-4b24-b251-f869fbbefdaf could not be found. Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a736d74-42d3-4b24-b251-f869fbbefdaf could not be found. Aug 09 19:19:11.739932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:19:11.741032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] Returning 404 to user: Instance 5a736d74-42d3-4b24-b251-f869fbbefdaf could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:19:11.741032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-215cf7bb-13eb-4682-b334-3d68ccddae0d tempest-ServerRescueNegativeTestJSON-593678341 tempest-ServerRescueNegativeTestJSON-593678341-project] 10.222.0.70 "GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf" status: 404 len: 111 microversion: 2.1 time: 0.032781 Aug 09 19:19:11.741032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 327/646] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:11 2022] GET /compute/v2.1/servers/5a736d74-42d3-4b24-b251-f869fbbefdaf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:19:11.829459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-8b7efbdd-acb6-4c2b-bada-b55b2e71d929 req-9bcf62ba-7b6f-4f3e-ad66-f74ee8ce3370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a736d74-42d3-4b24-b251-f869fbbefdaf", "name": "network-vif-deleted", "tag": "48165766-24be-4025-a8b1-68cbba240dc4"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:11.839929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-8b7efbdd-acb6-4c2b-bada-b55b2e71d929 req-9bcf62ba-7b6f-4f3e-ad66-f74ee8ce3370 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:11.840501 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-8b7efbdd-acb6-4c2b-bada-b55b2e71d929 req-9bcf62ba-7b6f-4f3e-ad66-f74ee8ce3370 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:11.841026 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-8b7efbdd-acb6-4c2b-bada-b55b2e71d929 req-9bcf62ba-7b6f-4f3e-ad66-f74ee8ce3370 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:11.852201 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-8b7efbdd-acb6-4c2b-bada-b55b2e71d929 req-9bcf62ba-7b6f-4f3e-ad66-f74ee8ce3370 service nova] Creating event network-vif-deleted:48165766-24be-4025-a8b1-68cbba240dc4 for instance 5a736d74-42d3-4b24-b251-f869fbbefdaf on hv-cinder-85265 Aug 09 19:19:11.857641 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-8b7efbdd-acb6-4c2b-bada-b55b2e71d929 req-9bcf62ba-7b6f-4f3e-ad66-f74ee8ce3370 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031217 Aug 09 19:19:11.858437 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 320/647] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:16.148846 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-687e8af7-3bc4-4e8d-aa76-e084a284ddcf tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:16.149959 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-687e8af7-3bc4-4e8d-aa76-e084a284ddcf tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:16.156313 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-687e8af7-3bc4-4e8d-aa76-e084a284ddcf tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:16.157056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-687e8af7-3bc4-4e8d-aa76-e084a284ddcf tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:16.157681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-687e8af7-3bc4-4e8d-aa76-e084a284ddcf tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:16.158373 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-687e8af7-3bc4-4e8d-aa76-e084a284ddcf tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:16.158823 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-687e8af7-3bc4-4e8d-aa76-e084a284ddcf tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:16.159241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-687e8af7-3bc4-4e8d-aa76-e084a284ddcf tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:16.188957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-687e8af7-3bc4-4e8d-aa76-e084a284ddcf tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/ips" status: 200 len: 151 microversion: 2.20 time: 0.212408 Aug 09 19:19:16.189521 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 328/648] 10.222.0.70 () {60 vars in 1289 bytes} [Tue Aug 9 19:19:15 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/ips => generated 151 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:19:17.589324 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-75aa94ce-d01d-436a-8d52-e0408826dbb9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:17.593111 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-75aa94ce-d01d-436a-8d52-e0408826dbb9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:17.601413 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-75aa94ce-d01d-436a-8d52-e0408826dbb9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:17.601911 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-75aa94ce-d01d-436a-8d52-e0408826dbb9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:17.602350 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-75aa94ce-d01d-436a-8d52-e0408826dbb9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:17.603057 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-75aa94ce-d01d-436a-8d52-e0408826dbb9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:17.603685 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-75aa94ce-d01d-436a-8d52-e0408826dbb9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:17.604267 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-75aa94ce-d01d-436a-8d52-e0408826dbb9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:17.638747 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-75aa94ce-d01d-436a-8d52-e0408826dbb9 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055052 Aug 09 19:19:17.639408 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 321/649] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:19:17 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:19:17.705879 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:17.706369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:17.712917 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:17.714892 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:17.715347 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:17.717303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:17.717303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:17.717303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:17.750254 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:19:17.834446 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5ad8c87a-5289-41f9-b380-4c64ca8c2ab6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 204 len: 0 microversion: 2.1 time: 0.132439 Aug 09 19:19:17.835613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 329/650] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:19:17 2022] DELETE /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:19:17.845515 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:17.846132 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:17.853639 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:17.854497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:17.855208 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:17.856275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:17.856751 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:17.857372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:18.005259 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:18.013812 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-48f1ed56-7cbd-4b23-bdc8-37f30130706c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1673 microversion: 2.1 time: 0.173496 Aug 09 19:19:18.014401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 322/651] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:17 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:18.814189 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:18.815500 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:18.823473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:18.824305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:18.825032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:18.825956 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:18.826623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:18.827339 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:18.851979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lazy-loading 'flavor' on Instance uuid c2fa3b0c-4952-4132-9fae-7b242fb393f5 {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:19:19.035523 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:19.036129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:19.045089 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:19.046033 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:19.047176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:19.048164 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:19.049124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:19.050011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:19.093615 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e45c7add-3fd2-4429-8b16-2c9dc6369ec3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/action" status: 202 len: 0 microversion: 2.20 time: 0.283458 Aug 09 19:19:19.094600 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 330/652] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Aug 9 19:19:18 2022] POST /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:19:19.105369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:19.106455 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:19.113628 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:19.114432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:19.115599 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:19.117223 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:19.118860 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:19.119494 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:19.213628 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:19.226511 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1e357821-c11b-445a-bee3-9199331db355 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1673 microversion: 2.1 time: 0.195200 Aug 09 19:19:19.228624 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 323/653] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:19 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:19.347803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:19.358673 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:19.360807 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:19.362027 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-9f9f75c7-66cd-4cf7-a42c-d1481de6512e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.263104 Aug 09 19:19:19.373650 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 331/654] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:19 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:20.251598 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:20.252866 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:20.260930 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:20.263272 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:20.263652 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:20.264379 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:20.267598 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:20.267932 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:20.385777 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:20.386383 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:20.395194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:20.395849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:20.397045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:20.398630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:20.399250 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:20.399493 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:20.609873 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:20.620821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:20.622732 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:20.625582 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3e76ea72-6d12-4553-921a-72e8cd7ee326 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.242318 Aug 09 19:19:20.625582 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 332/655] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:20 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 19:19:20.690284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-23f609aa-bd53-4688-8ce3-bfe79a169056 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: .version_select at 0x7fa508170f70>, body: {"keypair": {"name": "tempest-keypair-1975370595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTBId3/KQ6follQuYx1JILXyTyJFIioZpqhqTwmwQKIInZ17KGO2x/rpbqjPLHOy6x/RoTW+ibJ/oBYkYytcs367spbos5gsbY3qh0x9aJaCIXjpw77MiOeG2HvArWz5w=="}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:20.707273 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-23f609aa-bd53-4688-8ce3-bfe79a169056 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for project 46afad886ad34608b533f4ee80a18ba5. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:19:20.720016 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-23f609aa-bd53-4688-8ce3-bfe79a169056 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for user 4f7899ab15b347b7be75e3433f0d5450 and project 46afad886ad34608b533f4ee80a18ba5. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:19:20.747473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-23f609aa-bd53-4688-8ce3-bfe79a169056 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121341 Aug 09 19:19:20.748083 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 333/656] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:19:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:20.808538 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:20.822964 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-7f88190d-11b6-49c6-aabf-aff3d2dd1e1d tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1673 microversion: 2.1 time: 0.575598 Aug 09 19:19:20.823649 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 324/657] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:20 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1673 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:21.551544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-99b24393-9773-4d81-a245-4372aea51a5d req-2b8243f5-d28e-4f8c-a518-58d555de44e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab83633d-a2ac-4257-b317-ed1894b0fd8d", "name": "network-vif-deleted", "tag": "7542d5fc-836e-47fe-81ca-ad669ecb60de"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:21.577495 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-99b24393-9773-4d81-a245-4372aea51a5d req-2b8243f5-d28e-4f8c-a518-58d555de44e8 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:21.579558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-99b24393-9773-4d81-a245-4372aea51a5d req-2b8243f5-d28e-4f8c-a518-58d555de44e8 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:21.583049 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-99b24393-9773-4d81-a245-4372aea51a5d req-2b8243f5-d28e-4f8c-a518-58d555de44e8 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:21.602540 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-99b24393-9773-4d81-a245-4372aea51a5d req-2b8243f5-d28e-4f8c-a518-58d555de44e8 service nova] Creating event network-vif-deleted:7542d5fc-836e-47fe-81ca-ad669ecb60de for instance ab83633d-a2ac-4257-b317-ed1894b0fd8d on hv-cinder-85265 Aug 09 19:19:21.619002 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-99b24393-9773-4d81-a245-4372aea51a5d req-2b8243f5-d28e-4f8c-a518-58d555de44e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173284 Aug 09 19:19:21.619988 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 334/658] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:19:21.648536 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:21.649307 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:21.661725 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:21.664140 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:21.666070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:21.666855 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:21.667334 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:21.670378 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:21.845275 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:21.846180 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:21.855174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:21.855897 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:21.856527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:21.857738 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:21.858518 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:21.859217 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:21.865570 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:21.869514 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:21.877149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:21.879276 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:21.881072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-89f2f205-4d8c-40f5-84a3-eb663f6cf967 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.237311 Aug 09 19:19:21.883055 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 325/659] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:21 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:21.903537 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:21.904360 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:21.904990 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:21.905592 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lazy-loading 'fault' on Instance uuid ab83633d-a2ac-4257-b317-ed1894b0fd8d {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:19:21.977698 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:21.995539 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d3954284-9f8c-484b-8787-edc6d2bdf3a2 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 200 len: 1327 microversion: 2.1 time: 0.154420 Aug 09 19:19:21.996126 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 335/660] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:21 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 1327 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:22.381866 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2080316593", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f05d1eed-0f4c-4655-a75a-07649579d361"}], "security_groups": [{"name": "tempest-securitygroup--322490699"}], "key_name": "tempest-keypair-1975370595", "user_data": "}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:22.499608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] validate_networks() for [('f05d1eed-0f4c-4655-a75a-07649579d361', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:19:22.927496 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:22.928911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:22.937682 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:22.938579 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:22.938579 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:22.939284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:22.939719 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:22.940133 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:22.966978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:19:22.967672 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:19:22.968249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:19:22.968753 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:19:22.969240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:19:22.981832 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:22.982735 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:22.983440 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:22.984565 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:22.985224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:22.985845 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:23.006243 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for project 46afad886ad34608b533f4ee80a18ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:19:23.013883 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for user 4f7899ab15b347b7be75e3433f0d5450 and project 46afad886ad34608b533f4ee80a18ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:19:23.026585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:19:23.028901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:19:23.089822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8018795f-c1fc-48fd-891e-f8c829d36941 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.712052 Aug 09 19:19:23.091159 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 326/661] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:19:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:19:23.096660 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:23.097752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:23.107493 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:23.108207 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:23.109061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:23.109792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:23.110249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:23.110677 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:23.128157 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] HTTP exception thrown: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Request method failure captured: Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d HTTP/1.1 Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rJU7K0YksPxS5PePLTLPo3aGZVnPv84sX4rmdKaDE5XOERdmYnVzFuSttjBcGEAOVLCosJSyQ-OgOFPw9IXH9YjeEXRTi73GcgYruZvfSlWCeU5xLIKApzzwyorMIy3Jkeznbat5MSOIr1MavQBjLXCHDefd8flfQn4qBIk4TznfAc Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:19:23.130301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56cc04948356488f8722a735954fd650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56cc04948356488f8722a735954fd650"}]}] Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 05147fb1762748ee9866ccc5bff4d514 Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:19:23.132630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'ab83633d-a2ac-4257-b317-ed1894b0fd8d'} Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:19:23.133575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:19:23.135063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:19:23.137755 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Returning 404 to user: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:19:23.139489 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c0a9660a-44d5-483d-b174-8d2b2ed0b9db tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 404 len: 111 microversion: 2.1 time: 0.046767 Aug 09 19:19:23.143762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 327/662] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:23 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:19:23.150704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ca36db5f-60ff-45f7-991b-a7e1931aeafa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:23.151569 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ca36db5f-60ff-45f7-991b-a7e1931aeafa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:23.213247 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ca36db5f-60ff-45f7-991b-a7e1931aeafa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:23.221279 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ca36db5f-60ff-45f7-991b-a7e1931aeafa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1242 microversion: 2.1 time: 0.075926 Aug 09 19:19:23.226283 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 328/663] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:23 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:23.231200 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4feafbf6-2cd1-4849-977a-72a0f45aa8ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '.version_select at 0x7fa5035dbb80>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:23.270968 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4feafbf6-2cd1-4849-977a-72a0f45aa8ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159376809" status: 202 len: 0 microversion: 2.1 time: 0.043074 Aug 09 19:19:23.271720 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 329/664] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Aug 9 19:19:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159376809 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:19:23.525622 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:23.534581 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:23.537075 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:23.540799 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0e633430-9b40-4b40-b84f-782ccb4e86ad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.633791 Aug 09 19:19:23.560759 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 336/665] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:22 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:24.082933 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fe31e219-8d93-4209-a3b1-96dac6f15299 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'create', calling method: .version_select at 0x7fa5035a1f70>, body: {"keypair": {"name": "tempest-keypair-1719012478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMgMrEIvYGeswXEp8J3FXVjxzxhkORuko4sqiMQnoGWjUg7kTMtmrg0EkOCpO0/ztH1WtVmm6W53NHpeZLKe0tqHh7c89qtAYzMJhcBJnhA5gjDB6N36kcPOA3oHKhVfhg=="}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:24.099430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-fe31e219-8d93-4209-a3b1-96dac6f15299 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Getting quotas for project 56cc04948356488f8722a735954fd650. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:19:24.104948 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-fe31e219-8d93-4209-a3b1-96dac6f15299 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Getting quotas for user 05147fb1762748ee9866ccc5bff4d514 and project 56cc04948356488f8722a735954fd650. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:19:24.128362 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fe31e219-8d93-4209-a3b1-96dac6f15299 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049866 Aug 09 19:19:24.129029 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 330/666] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:19:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:24.245919 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:24.246668 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:24.253671 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:24.254166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:24.254781 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:24.255484 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:24.256095 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:24.256555 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:24.348216 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:24.358530 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-de68c684-d11a-437b-ba87-7deea9f9831f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1294 microversion: 2.1 time: 0.117911 Aug 09 19:19:24.361538 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 337/667] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:24 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:24.571576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:24.574713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:24.586412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:24.587214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:24.587855 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:24.588762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:24.589221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:24.589640 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:24.630059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:24.874790 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:24.887779 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:24.893016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:24.894759 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-547f5587-2e35-456f-82d9-aab696406546 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.334680 Aug 09 19:19:24.910105 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 331/668] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:24 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:25.386144 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:25.386758 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:25.405106 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:25.407323 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:25.407976 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:25.410175 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:25.415564 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:25.416263 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:25.714361 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:25.726756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e3dd96a2-9951-430a-b59f-30a969c85939 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1367 microversion: 2.1 time: 0.345153 Aug 09 19:19:25.728463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 338/669] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:25 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:25.919186 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:25.919784 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:25.927102 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:25.927723 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:25.928260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:25.929385 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:25.929873 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:25.930297 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:25.979615 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1731403846", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f60b7e99-fc43-4c9b-b9a0-a693e8be0c61"}], "security_groups": [{"name": "tempest-securitygroup--1078185046"}], "key_name": "tempest-keypair-1719012478", "user_data": "}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:26.092760 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] validate_networks() for [('f60b7e99-fc43-4c9b-b9a0-a693e8be0c61', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:19:26.135546 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:26.145975 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:26.149264 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:26.150612 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-979a042d-6e49-4e83-876d-6006fbe47cbe tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.235493 Aug 09 19:19:26.151602 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 332/670] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:25 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:26.373196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-402310e0-0572-4da2-86f6-056e04b8777b req-e9699722-3711-4c16-a5f6-c60b93802c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a42acc3-2c59-41b1-aaf2-323a41f9a49c", "tag": "ccf261a8-4dd0-437d-a49c-febccb36b700"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:26.386334 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-402310e0-0572-4da2-86f6-056e04b8777b req-e9699722-3711-4c16-a5f6-c60b93802c7f service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:26.387078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-402310e0-0572-4da2-86f6-056e04b8777b req-e9699722-3711-4c16-a5f6-c60b93802c7f service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:26.387675 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-402310e0-0572-4da2-86f6-056e04b8777b req-e9699722-3711-4c16-a5f6-c60b93802c7f service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:26.403140 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-402310e0-0572-4da2-86f6-056e04b8777b req-e9699722-3711-4c16-a5f6-c60b93802c7f service nova] Creating event network-changed:ccf261a8-4dd0-437d-a49c-febccb36b700 for instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c on hv-cinder-85265 Aug 09 19:19:26.408678 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-402310e0-0572-4da2-86f6-056e04b8777b req-e9699722-3711-4c16-a5f6-c60b93802c7f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045223 Aug 09 19:19:26.409472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 333/671] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 09 19:19:26.564963 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:19:26.565560 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:19:26.565901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:19:26.566423 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:19:26.566923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:19:26.576034 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:26.576559 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:26.577201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:26.577937 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:26.578395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:26.578822 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:26.596308 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Getting quotas for project 56cc04948356488f8722a735954fd650. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:19:26.600836 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Getting quotas for user 05147fb1762748ee9866ccc5bff4d514 and project 56cc04948356488f8722a735954fd650. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:19:26.613404 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:19:26.615877 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:19:26.666258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7f6cc137-c2cd-4fb0-a288-f4d1f6180f57 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691061 Aug 09 19:19:26.667577 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 339/672] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:19:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 19:19:26.679124 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-45c0be34-4043-4270-8092-8ae243ee1891 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:26.680053 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-45c0be34-4043-4270-8092-8ae243ee1891 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:26.744858 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-45c0be34-4043-4270-8092-8ae243ee1891 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:26.748082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:26.748589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:26.754808 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-45c0be34-4043-4270-8092-8ae243ee1891 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1238 microversion: 2.1 time: 0.080304 Aug 09 19:19:26.755288 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:26.755771 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:26.756202 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:26.757498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:26.758037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:26.758460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:26.769699 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 334/673] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:26 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:26.935979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:26.947512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f28b5263-aa67-45dd-bbb9-c735bbc95376 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1367 microversion: 2.1 time: 0.203319 Aug 09 19:19:26.948202 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 340/674] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:26 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:27.180000 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:27.180787 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:27.191612 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:27.192104 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:27.192576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:27.193286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:27.193738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:27.194792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:27.327175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:27.335106 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:27.336764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:27.337915 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5940013a-468a-45c4-964f-4fdbbfd1c87c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.162979 Aug 09 19:19:27.338469 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 335/675] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:27 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:27.776671 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:27.777252 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:27.783683 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:27.784167 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:27.784645 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:27.785330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:27.785775 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:27.786191 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:27.868400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:27.875777 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-81b6552f-eb38-4154-a6da-33ed459cc305 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1242 microversion: 2.1 time: 0.103693 Aug 09 19:19:27.876688 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 341/676] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:27 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1242 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:27.970110 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:27.971156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:27.979197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:27.979999 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:27.980696 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:27.981866 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:27.982571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:27.983197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:28.162406 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:28.169867 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4e9009b0-0584-4ed9-ba5f-c9bcfe4d10f9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1367 microversion: 2.1 time: 0.204501 Aug 09 19:19:28.170420 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 336/677] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:27 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:28.362013 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:28.362536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:28.369346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:28.369880 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:28.370264 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:28.371114 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:28.371569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:28.371988 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:28.607430 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:28.616266 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:28.618236 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:28.619555 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-78a43060-f951-4ab6-a6c4-afa86efb09a7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.261903 Aug 09 19:19:28.620246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 342/678] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:28 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:28.898960 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:28.899566 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:28.905681 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:28.906162 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:28.906589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:28.907308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:28.907752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:28.908165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:28.976553 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:28.984686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e7c2aa72-1e96-49d7-83a6-c1267d182da1 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1296 microversion: 2.1 time: 0.090265 Aug 09 19:19:28.986079 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 337/679] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:28 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:29.191710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:29.192514 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:29.201176 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:29.201799 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:29.202599 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:29.203669 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:29.204271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:29.204981 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:29.418948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:29.426602 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2d70c274-7062-4f9c-8b47-bdbcbf548776 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1367 microversion: 2.1 time: 0.239417 Aug 09 19:19:29.427374 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 343/680] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:29 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:29.643047 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:29.643910 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:29.646105 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:29.652366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:29.652962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:29.653467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:29.654263 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:29.654784 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:29.655275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:29.801693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:29.810358 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:29.811857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:29.813037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e259700d-66df-4490-acbd-64b9b12201d5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.173993 Aug 09 19:19:29.813598 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 338/681] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:29 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:30.007333 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:30.008128 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:30.016219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:30.016887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:30.017535 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:30.018689 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:30.019399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:30.020272 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:30.024594 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-cf5f802f-8ccd-4fa5-82c2-4f3a400d7b10 req-177b5fdc-03b5-4f05-bfba-547aed235615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85f13dd-9356-4c14-ae58-dbccafee0a9a", "tag": "f36f87a5-4bb1-4c40-b98d-eea17d6228e8"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:30.034088 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-cf5f802f-8ccd-4fa5-82c2-4f3a400d7b10 req-177b5fdc-03b5-4f05-bfba-547aed235615 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:30.034576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-cf5f802f-8ccd-4fa5-82c2-4f3a400d7b10 req-177b5fdc-03b5-4f05-bfba-547aed235615 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:30.034993 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-cf5f802f-8ccd-4fa5-82c2-4f3a400d7b10 req-177b5fdc-03b5-4f05-bfba-547aed235615 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:30.047171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-cf5f802f-8ccd-4fa5-82c2-4f3a400d7b10 req-177b5fdc-03b5-4f05-bfba-547aed235615 service nova] Creating event network-changed:f36f87a5-4bb1-4c40-b98d-eea17d6228e8 for instance e85f13dd-9356-4c14-ae58-dbccafee0a9a on hv-cinder-85265 Aug 09 19:19:30.051952 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-cf5f802f-8ccd-4fa5-82c2-4f3a400d7b10 req-177b5fdc-03b5-4f05-bfba-547aed235615 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120237 Aug 09 19:19:30.052746 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 344/682] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:30.168887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:30.176821 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5bf7402d-d687-4f94-aaee-2dcd754de063 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1364 microversion: 2.1 time: 0.173910 Aug 09 19:19:30.177387 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 339/683] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:30 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:30.448266 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:30.448988 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:30.455173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:30.455651 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:30.456090 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:30.456834 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:30.457315 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:30.457740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:30.588940 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:30.596323 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6c2bbce8-b6eb-420a-b029-b817d69b6dfd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1367 microversion: 2.1 time: 0.152903 Aug 09 19:19:30.596922 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 345/684] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:30 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:30.836836 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:30.837359 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:30.843230 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:30.843700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:30.844127 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:30.844842 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:30.845280 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:30.845694 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:30.973536 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:30.982524 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:30.984056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:30.985247 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bcdfa2d5-0098-4740-b5eb-b15997f0f203 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1745 microversion: 2.20 time: 0.152958 Aug 09 19:19:30.985837 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 340/685] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:30 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:31.198718 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:31.199608 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:31.206198 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:31.206679 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:31.207109 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:31.207791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:31.208236 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:31.208687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:31.340209 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:31.347714 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-044c1bbf-8ec9-4e47-a40c-6674946e1b6c tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1364 microversion: 2.1 time: 0.153663 Aug 09 19:19:31.348280 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 346/686] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:31 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:31.519468 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-523f8bfd-e96e-417a-ba78-279d87b98860 req-521221eb-ac4f-4a95-85c8-aaaec8fb7cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a42acc3-2c59-41b1-aaf2-323a41f9a49c", "name": "network-vif-plugged", "status": "completed", "tag": "ccf261a8-4dd0-437d-a49c-febccb36b700"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:31.530822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-523f8bfd-e96e-417a-ba78-279d87b98860 req-521221eb-ac4f-4a95-85c8-aaaec8fb7cb6 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:31.531322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-523f8bfd-e96e-417a-ba78-279d87b98860 req-521221eb-ac4f-4a95-85c8-aaaec8fb7cb6 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:31.531750 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-523f8bfd-e96e-417a-ba78-279d87b98860 req-521221eb-ac4f-4a95-85c8-aaaec8fb7cb6 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:31.544994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-523f8bfd-e96e-417a-ba78-279d87b98860 req-521221eb-ac4f-4a95-85c8-aaaec8fb7cb6 service nova] Creating event network-vif-plugged:ccf261a8-4dd0-437d-a49c-febccb36b700 for instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c on hv-cinder-85265 Aug 09 19:19:31.550321 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-523f8bfd-e96e-417a-ba78-279d87b98860 req-521221eb-ac4f-4a95-85c8-aaaec8fb7cb6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034627 Aug 09 19:19:31.551439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 341/687] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:31.618344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:31.619035 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:31.626228 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:31.626708 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:31.627745 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:31.628478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:31.628918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:31.629332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:31.843923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:31.851487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d3de40ea-4d57-4b50-b814-158a735f3cf4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1367 microversion: 2.1 time: 0.238338 Aug 09 19:19:31.852087 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 347/688] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:31 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:32.009981 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:32.010695 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:32.016798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:32.017275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:32.017731 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:32.018415 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:32.018860 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:32.019281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:32.152026 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:32.160205 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:32.161737 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:32.162889 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-475f86bb-ef74-4513-9691-170a5ca4d86f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1745 microversion: 2.20 time: 0.158089 Aug 09 19:19:32.163638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 342/689] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:32 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:32.369248 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:32.369856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:32.375777 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:32.376248 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:32.376715 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:32.377398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:32.377842 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:32.378259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:32.505137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:32.513294 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-32f7b1da-e2c0-4a5e-bf3c-29d98fe58b56 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1364 microversion: 2.1 time: 0.148538 Aug 09 19:19:32.513868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 348/690] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:32 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:32.871845 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:32.872739 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:32.880168 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:32.880794 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:32.881099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:32.881812 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:32.882262 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:32.882682 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:32.997445 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:33.026760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:33.035218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-88480030-ac09-49ea-aaec-5eb25d0217af tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1367 microversion: 2.1 time: 0.167236 Aug 09 19:19:33.036165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 343/691] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:32 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:33.186690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:33.187381 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:33.190901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:33.194427 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:33.195017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:33.195450 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:33.196137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:33.196614 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:33.197032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:33.357422 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:33.372488 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:33.374279 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:33.375605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-93568e5a-bf4f-4c42-aa41-e1a4dbf8603c tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1740 microversion: 2.20 time: 0.192853 Aug 09 19:19:33.382325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 349/692] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:33 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:33.534870 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:33.535875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:33.549219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:33.554050 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:33.554739 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:33.555444 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:33.555972 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:33.556702 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:33.735496 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:33.747058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-928c2b78-37b4-445a-bd91-338125a4a4c6 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1364 microversion: 2.1 time: 0.216138 Aug 09 19:19:33.747771 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 344/693] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:33 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:34.058366 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:34.059342 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:34.065868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:34.066171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:34.066603 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:34.067498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:34.067949 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:34.068618 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:34.235043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:34.246132 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6c51d2ae-a68e-4378-838c-8cafd5c40364 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1557 microversion: 2.1 time: 0.192589 Aug 09 19:19:34.247435 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 350/694] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:34 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1557 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:34.274473 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f924bd59-802f-4bdd-9ac6-4e6f7ca63e3b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:34.275650 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f924bd59-802f-4bdd-9ac6-4e6f7ca63e3b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:34.284371 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f924bd59-802f-4bdd-9ac6-4e6f7ca63e3b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:34.285176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f924bd59-802f-4bdd-9ac6-4e6f7ca63e3b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:34.285611 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f924bd59-802f-4bdd-9ac6-4e6f7ca63e3b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:34.286328 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f924bd59-802f-4bdd-9ac6-4e6f7ca63e3b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:34.286799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f924bd59-802f-4bdd-9ac6-4e6f7ca63e3b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:34.287220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f924bd59-802f-4bdd-9ac6-4e6f7ca63e3b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:34.380796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f924bd59-802f-4bdd-9ac6-4e6f7ca63e3b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111120 Aug 09 19:19:34.381926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 345/695] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Aug 9 19:19:34 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:34.402802 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:34.404271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:34.410592 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:34.411314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:34.411906 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:34.412840 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:34.413440 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:34.414010 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:34.771336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:34.772003 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:34.785918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:34.792400 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:34.797470 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:34.810337 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:34.810848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:34.811331 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:34.993419 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:35.002058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-53628a32-8205-4077-b469-5943fe6f1bfd tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1364 microversion: 2.1 time: 0.236264 Aug 09 19:19:35.013044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 346/696] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:34 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:35.019542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:35.033524 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:35.035816 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:35.037282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f4495d9e-d47c-442e-b6d1-e2c4a66e8110 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1740 microversion: 2.20 time: 0.642069 Aug 09 19:19:35.038465 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 351/697] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:34 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1740 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:35.555218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-496351ae-a56b-4d01-8f1c-1ece5f250664 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:35.557946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-496351ae-a56b-4d01-8f1c-1ece5f250664 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:35.574369 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-496351ae-a56b-4d01-8f1c-1ece5f250664 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:35.575161 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-496351ae-a56b-4d01-8f1c-1ece5f250664 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:35.575774 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-496351ae-a56b-4d01-8f1c-1ece5f250664 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:35.576674 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-496351ae-a56b-4d01-8f1c-1ece5f250664 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:35.577283 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-496351ae-a56b-4d01-8f1c-1ece5f250664 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:35.577871 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-496351ae-a56b-4d01-8f1c-1ece5f250664 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:35.664948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-ac6f0407-5006-4980-8fb1-e6b8ebd7e581 req-d8dea654-ee07-4760-b91d-c7d6048c5a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85f13dd-9356-4c14-ae58-dbccafee0a9a", "name": "network-vif-plugged", "status": "completed", "tag": "f36f87a5-4bb1-4c40-b98d-eea17d6228e8"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:35.687109 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-ac6f0407-5006-4980-8fb1-e6b8ebd7e581 req-d8dea654-ee07-4760-b91d-c7d6048c5a69 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:35.687490 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-496351ae-a56b-4d01-8f1c-1ece5f250664 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "POST /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.136087 Aug 09 19:19:35.688115 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-ac6f0407-5006-4980-8fb1-e6b8ebd7e581 req-d8dea654-ee07-4760-b91d-c7d6048c5a69 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:35.688798 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-ac6f0407-5006-4980-8fb1-e6b8ebd7e581 req-d8dea654-ee07-4760-b91d-c7d6048c5a69 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:35.689345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 347/698] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:19:35 2022] POST /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:19:35.703845 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:35.705459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:35.714025 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:35.714866 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:35.715508 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:35.716587 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:35.717295 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:35.717922 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:35.718990 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-ac6f0407-5006-4980-8fb1-e6b8ebd7e581 req-d8dea654-ee07-4760-b91d-c7d6048c5a69 service nova] Creating event network-vif-plugged:f36f87a5-4bb1-4c40-b98d-eea17d6228e8 for instance e85f13dd-9356-4c14-ae58-dbccafee0a9a on hv-cinder-85265 Aug 09 19:19:35.736201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-ac6f0407-5006-4980-8fb1-e6b8ebd7e581 req-d8dea654-ee07-4760-b91d-c7d6048c5a69 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074834 Aug 09 19:19:35.737235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 352/699] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:19:35.946432 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:35.965926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0ea26b84-1dec-4d98-9fe8-8c2f49a88c7b tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1750 microversion: 2.1 time: 0.272134 Aug 09 19:19:35.967688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 348/700] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:35 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1750 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:36.027739 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:36.029574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:36.040266 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:36.041396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:36.042245 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:36.043567 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:36.044302 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:36.045156 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:36.063929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:36.064831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:36.087022 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:36.087917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:36.088677 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:36.089629 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:36.090300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:36.090959 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:36.114429 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:36.344383 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:36.346948 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:36.361380 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:36.363192 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:36.364571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ac53fc0c-dbbd-42ea-b823-c33a1fc63069 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1740 microversion: 2.20 time: 0.306208 Aug 09 19:19:36.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 349/701] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:36 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1740 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:36.509283 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-c72318e2-9d17-47f0-ab0a-b5c92414ecdd req-fd53ffba-9543-4c90-b063-ab3c8e56898b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a42acc3-2c59-41b1-aaf2-323a41f9a49c", "tag": "ccf261a8-4dd0-437d-a49c-febccb36b700"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:36.520011 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:36.528724 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-c72318e2-9d17-47f0-ab0a-b5c92414ecdd req-fd53ffba-9543-4c90-b063-ab3c8e56898b service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:36.529378 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-c72318e2-9d17-47f0-ab0a-b5c92414ecdd req-fd53ffba-9543-4c90-b063-ab3c8e56898b service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:36.529921 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-c72318e2-9d17-47f0-ab0a-b5c92414ecdd req-fd53ffba-9543-4c90-b063-ab3c8e56898b service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:36.531884 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-9df9aa11-a056-4744-aae1-15146cf652f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1364 microversion: 2.1 time: 0.510494 Aug 09 19:19:36.551619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 353/702] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:36 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:36.557656 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-c72318e2-9d17-47f0-ab0a-b5c92414ecdd req-fd53ffba-9543-4c90-b063-ab3c8e56898b service nova] Creating event network-changed:ccf261a8-4dd0-437d-a49c-febccb36b700 for instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c on hv-cinder-85265 Aug 09 19:19:36.567474 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-c72318e2-9d17-47f0-ab0a-b5c92414ecdd req-fd53ffba-9543-4c90-b063-ab3c8e56898b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064523 Aug 09 19:19:36.568256 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 350/703] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:36.987150 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:36.988487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:36.999081 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:37.003189 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=10 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:37.007542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:37.012457 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:37.013412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:37.014875 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:37.018684 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:37.019338 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:37.288903 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:37.302602 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b26d510a-de9e-4611-af7e-7c8bc21360f1 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1750 microversion: 2.1 time: 0.318644 Aug 09 19:19:37.305086 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 354/704] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:36 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1750 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:37.385098 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=14 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:37.391667 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:37.392881 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:37.404646 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:37.405308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:37.405967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:37.406861 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:37.407413 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:37.408012 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:37.559513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:37.560603 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:37.572284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:37.572949 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:37.573337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:37.574094 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:37.574548 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:37.575196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:37.592735 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:37.608398 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:37.610865 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:37.621279 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-158dc30f-4f1b-4b97-bdcf-3168bce65fe6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1740 microversion: 2.20 time: 0.236326 Aug 09 19:19:37.623179 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 351/705] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:37 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:37.802019 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:37.825524 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6c549a7d-2102-4ed4-96f8-26e39be4db29 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1364 microversion: 2.1 time: 0.269903 Aug 09 19:19:37.826908 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 355/706] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:37 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:37.832533 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-c31c682e-e01e-44c6-a2a8-038def8e7576 req-d58e2f82-67f2-4730-9e0f-c30b9a60e14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fa3b0c-4952-4132-9fae-7b242fb393f5", "name": "network-vif-plugged", "status": "completed", "tag": "422e722d-30ec-4f63-8a1b-d4c21996173d"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:37.851110 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-c31c682e-e01e-44c6-a2a8-038def8e7576 req-d58e2f82-67f2-4730-9e0f-c30b9a60e14d service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:37.865244 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-c31c682e-e01e-44c6-a2a8-038def8e7576 req-d58e2f82-67f2-4730-9e0f-c30b9a60e14d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:37.866206 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-c31c682e-e01e-44c6-a2a8-038def8e7576 req-d58e2f82-67f2-4730-9e0f-c30b9a60e14d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:37.883278 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-c31c682e-e01e-44c6-a2a8-038def8e7576 req-d58e2f82-67f2-4730-9e0f-c30b9a60e14d service nova] Creating event network-vif-plugged:422e722d-30ec-4f63-8a1b-d4c21996173d for instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 on hv-cinder-85265 Aug 09 19:19:37.889970 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-c31c682e-e01e-44c6-a2a8-038def8e7576 req-d58e2f82-67f2-4730-9e0f-c30b9a60e14d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060594 Aug 09 19:19:37.891345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 352/707] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:38.327699 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:38.328459 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:38.337295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:38.337898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:38.338372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:38.339275 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:38.339724 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:38.340137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:38.515184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:38.525956 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-481ce164-be87-44e1-80a6-fb5c696ddf4a tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1755 microversion: 2.1 time: 0.203117 Aug 09 19:19:38.540829 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 356/708] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:38 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1755 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:38.653598 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:38.654928 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:38.663167 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:38.663666 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:38.664097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:38.664821 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:38.665594 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:38.666014 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:38.841318 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:38.852686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:38.853160 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:38.853849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:38.855266 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:38.856666 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-aa20b0da-6dc1-418a-bd38-d70c299a0330 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1740 microversion: 2.20 time: 0.207396 Aug 09 19:19:38.868470 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:38.868470 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:38.868470 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:38.868470 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:38.868938 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:38.868938 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:38.869852 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 353/709] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:38 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:39.034406 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:39.043451 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ce0bc962-6bab-439a-83fb-492866c75a18 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1550 microversion: 2.1 time: 0.196005 Aug 09 19:19:39.044231 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 357/710] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:38 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1550 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:39.065355 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a79d6ec3-9eee-4690-ab73-078ce07c6d00 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:39.066111 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a79d6ec3-9eee-4690-ab73-078ce07c6d00 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:39.073259 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a79d6ec3-9eee-4690-ab73-078ce07c6d00 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:39.073696 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a79d6ec3-9eee-4690-ab73-078ce07c6d00 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:39.074495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a79d6ec3-9eee-4690-ab73-078ce07c6d00 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:39.075071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a79d6ec3-9eee-4690-ab73-078ce07c6d00 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:39.075517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a79d6ec3-9eee-4690-ab73-078ce07c6d00 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:39.075934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a79d6ec3-9eee-4690-ab73-078ce07c6d00 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:39.169858 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a79d6ec3-9eee-4690-ab73-078ce07c6d00 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108239 Aug 09 19:19:39.170821 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 354/711] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Aug 9 19:19:39 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:39.551203 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:39.552542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:39.560700 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:39.561446 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:39.562065 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:39.562950 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:39.563557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:39.564269 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:39.749217 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:39.760161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0a1eed7c-2d36-4488-b630-ef3638b5bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1755 microversion: 2.1 time: 0.213908 Aug 09 19:19:39.761179 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 358/712] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:39 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:39.885183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:39.886629 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:39.894254 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:39.895313 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:39.896034 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:39.897094 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:39.897917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:39.898844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:40.161551 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:40.175391 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:40.179070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:40.181435 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d7014c13-1707-437a-b96c-a6cfd99bd578 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1740 microversion: 2.20 time: 0.302459 Aug 09 19:19:40.182575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 355/713] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:39 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:40.659693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-d48799f3-9445-4145-ae12-48a8fed10e3b req-2922c677-2e69-4e9a-9fdd-f1c85dc31896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85f13dd-9356-4c14-ae58-dbccafee0a9a", "tag": "f36f87a5-4bb1-4c40-b98d-eea17d6228e8"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:40.672631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d48799f3-9445-4145-ae12-48a8fed10e3b req-2922c677-2e69-4e9a-9fdd-f1c85dc31896 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:40.673409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d48799f3-9445-4145-ae12-48a8fed10e3b req-2922c677-2e69-4e9a-9fdd-f1c85dc31896 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:40.674011 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d48799f3-9445-4145-ae12-48a8fed10e3b req-2922c677-2e69-4e9a-9fdd-f1c85dc31896 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:40.691764 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-d48799f3-9445-4145-ae12-48a8fed10e3b req-2922c677-2e69-4e9a-9fdd-f1c85dc31896 service nova] Creating event network-changed:f36f87a5-4bb1-4c40-b98d-eea17d6228e8 for instance e85f13dd-9356-4c14-ae58-dbccafee0a9a on hv-cinder-85265 Aug 09 19:19:40.700754 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-d48799f3-9445-4145-ae12-48a8fed10e3b req-2922c677-2e69-4e9a-9fdd-f1c85dc31896 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044408 Aug 09 19:19:40.702686 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 359/714] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:19:40.783653 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:40.784751 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:40.793514 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:40.795075 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:40.795524 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:40.796847 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:40.797486 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:40.798099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:41.108059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:41.121050 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-72f5e44b-cc52-4649-9d49-afc7ac1a6821 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1755 microversion: 2.1 time: 0.341591 Aug 09 19:19:41.127200 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 356/715] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:40 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1755 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:41.206491 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:41.207539 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:41.224991 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:41.226650 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:41.227341 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:41.228330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:41.229048 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:41.229719 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:41.479675 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:41.496266 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:41.497836 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:41.499037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e8d4ca38-66d7-4d82-8600-9f9661506c87 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1740 microversion: 2.20 time: 0.297292 Aug 09 19:19:41.501823 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 360/716] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:41 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:42.154093 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:42.155750 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:42.165612 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:42.166095 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:42.166533 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:42.167335 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:42.167953 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:42.168377 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:42.368606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:42.377438 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e7d0102d-33b8-4bbf-bc96-da3a759494ca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1755 microversion: 2.1 time: 0.229469 Aug 09 19:19:42.380492 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 357/717] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:42 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1755 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:42.523676 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:42.524398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:42.532154 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:42.533110 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:42.533362 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:42.534235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:42.534927 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:42.535313 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:42.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:42.698598 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:42.700258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:42.701649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e66c06cb-2208-4291-8c10-104d62266d85 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1740 microversion: 2.20 time: 0.182607 Aug 09 19:19:42.702338 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 361/718] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:42 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:43.400701 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:43.401330 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:43.408241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:43.408761 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:43.409190 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:43.409883 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:43.410330 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:43.410743 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:43.565552 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:43.573730 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e03c36fb-9f3e-45ee-9e70-1550360584b2 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1755 microversion: 2.1 time: 0.178270 Aug 09 19:19:43.574401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 358/719] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:43 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:43.726353 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:43.726960 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:43.733368 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:43.733845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:43.734273 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:43.734959 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:43.735405 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:43.735825 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:43.874317 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:43.883005 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:43.884558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:43.885709 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5f8fa446-9c71-4f08-addb-025572bb91c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1740 microversion: 2.20 time: 0.163899 Aug 09 19:19:43.886273 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 362/720] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:43 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:44.595754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:44.596367 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:44.603494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:44.603985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:44.604419 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:44.605142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:44.605595 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:44.606019 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:44.754237 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:44.762227 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-470f471e-afac-48fb-b670-de3d4fc6de49 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1755 microversion: 2.1 time: 0.170375 Aug 09 19:19:44.762793 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 359/721] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:44 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:44.909887 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:44.910497 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:44.917643 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:44.918119 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:44.918548 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:44.919227 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:44.919673 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:44.920090 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:45.051309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:45.059833 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:45.061351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:45.062488 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-13e97130-83c5-4776-9a90-c2a2f9aad12d tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1722 microversion: 2.20 time: 0.156782 Aug 09 19:19:45.063041 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 363/722] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:44 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:45.784336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:45.784980 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:45.791850 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:45.792342 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:45.792819 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:45.793515 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:45.793971 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:45.794399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:45.938252 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:45.947055 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ea274b14-2484-4d8b-b46f-c548de5d2842 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1755 microversion: 2.1 time: 0.166667 Aug 09 19:19:45.947617 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 360/723] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:45 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:46.086190 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:46.086731 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:46.093227 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:46.093706 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:46.094140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:46.094826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:46.095274 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:46.095693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:46.228085 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:46.235976 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:46.237512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:46.238649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-83caa1a2-4056-4bc8-9817-36909e434ba7 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1722 microversion: 2.20 time: 0.156450 Aug 09 19:19:46.239216 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 364/724] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:46 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:46.967955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:46.968603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:46.975407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:46.975848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:46.976273 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:46.976989 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:46.977435 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:46.977851 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:47.125183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:47.133516 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d16b2ea2-f4e2-4b64-83c6-f22c6acc9c12 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1755 microversion: 2.1 time: 0.169411 Aug 09 19:19:47.134073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 361/725] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:46 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:47.262944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:47.263571 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:47.270273 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:47.270753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:47.271194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:47.272010 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:47.272739 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:47.273167 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:47.405355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:47.413242 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:47.414747 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:47.415892 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ec0f77ae-b998-4b41-86ad-7c99ba422080 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1665 microversion: 2.20 time: 0.156878 Aug 09 19:19:47.416470 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 365/726] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:47 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:47.439150 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ae9aa3ad-e968-4fab-b39c-e4d7924fcb32 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4426e28-04ff-4825-8673-e0e034ebc02b"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:47.441532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ae9aa3ad-e968-4fab-b39c-e4d7924fcb32 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:47.448115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae9aa3ad-e968-4fab-b39c-e4d7924fcb32 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:47.448635 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae9aa3ad-e968-4fab-b39c-e4d7924fcb32 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:47.449070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae9aa3ad-e968-4fab-b39c-e4d7924fcb32 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:47.449760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae9aa3ad-e968-4fab-b39c-e4d7924fcb32 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:47.450209 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae9aa3ad-e968-4fab-b39c-e4d7924fcb32 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:47.450629 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ae9aa3ad-e968-4fab-b39c-e4d7924fcb32 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:47.681554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-8d6bf222-eadb-46c2-9270-6c67a04aeeac req-85dca00e-ccdb-43a9-9fa8-91a1973e54d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fa3b0c-4952-4132-9fae-7b242fb393f5", "name": "network-vif-unplugged", "status": "completed", "tag": "422e722d-30ec-4f63-8a1b-d4c21996173d"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:47.691006 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-8d6bf222-eadb-46c2-9270-6c67a04aeeac req-85dca00e-ccdb-43a9-9fa8-91a1973e54d4 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:47.691408 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-8d6bf222-eadb-46c2-9270-6c67a04aeeac req-85dca00e-ccdb-43a9-9fa8-91a1973e54d4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:47.691836 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-8d6bf222-eadb-46c2-9270-6c67a04aeeac req-85dca00e-ccdb-43a9-9fa8-91a1973e54d4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:47.703255 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.compute.server_external_events [req-8d6bf222-eadb-46c2-9270-6c67a04aeeac req-85dca00e-ccdb-43a9-9fa8-91a1973e54d4 service nova] Unable to find a host for instance c2fa3b0c-4952-4132-9fae-7b242fb393f5. Dropping event network-vif-unplugged {{(pid=117823) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 19:19:47.704201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-8d6bf222-eadb-46c2-9270-6c67a04aeeac req-85dca00e-ccdb-43a9-9fa8-91a1973e54d4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.096254 Aug 09 19:19:47.704846 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 366/727] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 97 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 19:19:47.904865 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ae9aa3ad-e968-4fab-b39c-e4d7924fcb32 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.469599 Aug 09 19:19:47.910504 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 362/728] 10.222.0.70 () {62 vars in 1364 bytes} [Tue Aug 9 19:19:47 2022] POST /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/os-volume_attachments => generated 188 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 19:19:48.027519 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f8d95840-2bcd-4cca-b480-e38b96c65b28 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:48.028016 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f8d95840-2bcd-4cca-b480-e38b96c65b28 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:48.034219 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8d95840-2bcd-4cca-b480-e38b96c65b28 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:48.034708 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8d95840-2bcd-4cca-b480-e38b96c65b28 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:48.035143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8d95840-2bcd-4cca-b480-e38b96c65b28 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:48.035869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8d95840-2bcd-4cca-b480-e38b96c65b28 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:48.036323 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8d95840-2bcd-4cca-b480-e38b96c65b28 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:48.036779 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f8d95840-2bcd-4cca-b480-e38b96c65b28 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:48.154830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:48.155631 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:48.161782 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:48.163010 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:48.163533 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:48.164223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:48.164703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:48.165130 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:48.286137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f8d95840-2bcd-4cca-b480-e38b96c65b28 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/os-volume_attachments/c4426e28-04ff-4825-8673-e0e034ebc02b" status: 202 len: 0 microversion: 2.20 time: 0.262494 Aug 09 19:19:48.286744 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 367/729] 10.222.0.70 () {60 vars in 1457 bytes} [Tue Aug 9 19:19:48 2022] DELETE /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/os-volume_attachments/c4426e28-04ff-4825-8673-e0e034ebc02b => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:19:48.317315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:48.326291 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8f74e8e5-84cb-49fc-87dc-040b7fb543fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1755 microversion: 2.1 time: 0.175325 Aug 09 19:19:48.326854 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 363/730] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:48 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:48.353812 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:19:48.354400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:48.361000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:48.361476 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:48.361903 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:48.362583 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:48.363026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:48.363439 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:48.405389 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117823) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 19:19:48.439763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:48.473425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-cbeb5fae-726f-4616-bada-63db174f3753 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "POST /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/action" status: 202 len: 0 microversion: 2.20 time: 0.124156 Aug 09 19:19:48.474203 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 368/731] 10.222.0.70 () {62 vars in 1319 bytes} [Tue Aug 9 19:19:48 2022] POST /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:19:48.482897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:48.483497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:48.490112 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:48.490651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:48.491589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:48.492588 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:48.492985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:48.493497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:48.658717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:48.667430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:48.668953 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:48.670100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4752cd09-8bba-4d01-818a-6f8ecd54742b tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1673 microversion: 2.20 time: 0.191079 Aug 09 19:19:48.670649 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 364/732] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:48 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1673 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:49.349244 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:49.349944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:49.357307 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:49.357786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:49.358213 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:49.358924 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:49.359568 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:49.359987 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:49.508562 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:49.517028 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-06ae7b46-70aa-4191-ba19-31c86728ef50 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1758 microversion: 2.1 time: 0.172120 Aug 09 19:19:49.517612 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 369/733] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:49 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:49.693177 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:49.693741 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:49.700190 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:49.700698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:49.701126 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:49.701849 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:49.702279 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:49.702723 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:49.717957 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:19:49.872806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:49.880918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:49.882595 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:49.883917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-52a13515-6478-4e85-8883-c5d30c1ba8d6 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.194659 Aug 09 19:19:49.884499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 365/734] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:49 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:50.925264 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:50.927327 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:50.939721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:50.941214 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:50.942478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:50.943830 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:50.944575 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:50.945791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:50.979958 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:50.980517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:50.987537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:50.988548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:50.989398 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:50.990662 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:50.991426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:50.992756 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:51.043246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:19:51.160556 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:51.163633 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9ba2da93-ddfa-45c6-82c3-2fc2b6410ae7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 204 len: 0 microversion: 2.1 time: 0.187292 Aug 09 19:19:51.164775 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 366/735] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:19:50 2022] DELETE /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 19:19:51.169212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:51.170700 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:51.172108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-50841646-ad8c-452b-b742-8c4904284006 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.268014 Aug 09 19:19:51.173019 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 370/736] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:50 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:51.174530 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:51.175658 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:51.182411 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:51.182901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:51.183343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:51.184045 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:51.184535 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:51.184967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:51.330907 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:51.339396 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1ad60509-f600-4c7e-9a11-83fa15289baf tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.170326 Aug 09 19:19:51.340070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 367/737] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:51 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:52.196356 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:52.197720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:52.204782 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:52.205367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:52.205829 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:52.206552 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:52.206999 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:52.207567 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:52.349975 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:52.359243 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:52.360803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:52.361979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ae8daf47-0e97-43dd-a558-de04dffa0710 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.170118 Aug 09 19:19:52.364298 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 371/738] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:52 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:52.364513 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:52.365321 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:52.374644 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:52.375171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:52.375641 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:52.376349 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:52.376831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:52.377258 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:52.530149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:52.537865 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-83bf6ca2-f517-42e4-94bc-71fcf74b4eeb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.178398 Aug 09 19:19:52.538679 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 368/739] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:52 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:53.396833 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:53.397454 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:53.410103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:53.411043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:53.411501 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:53.412219 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:53.413029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:53.413748 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:53.559845 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:53.560783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:53.567153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:53.567918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:53.568352 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:53.568522 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:53.569118 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:53.569572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:53.570143 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:53.578689 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:53.580196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:53.581386 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b9f60a1d-f137-4d5e-a27c-b80225bcb761 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.192691 Aug 09 19:19:53.583427 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 372/740] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:53 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:53.725336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:53.734164 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bb284044-4839-41e3-ae8c-60adaa4a8611 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.178303 Aug 09 19:19:53.734925 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 369/741] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:53 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:54.603442 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:54.604147 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:54.611095 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:54.611801 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:54.612538 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:54.613274 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:54.613718 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:54.614134 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:54.755154 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:54.757754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:54.758637 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:54.765122 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:54.765528 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:54.765674 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:54.766035 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:54.766733 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:54.767047 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:54.767173 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:54.767586 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:54.768224 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3512514d-023a-4880-a575-4945bd25bbe8 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.168808 Aug 09 19:19:54.769277 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 373/742] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:54 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:54.926158 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:54.934902 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-dc3f31f6-cf49-4a5c-8acf-0c09fb6ba5fe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.182153 Aug 09 19:19:54.935547 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 370/743] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:54 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:55.792156 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:55.792985 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:55.799786 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:55.800285 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:55.800734 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:55.801547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:55.802000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:55.802422 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:55.944422 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:55.952763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:55.954294 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:55.955436 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-971b600a-4ddc-4341-8255-254725b6111f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.167948 Aug 09 19:19:55.958249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:55.959514 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:55.966804 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:55.967381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:55.967909 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:55.968743 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:55.969738 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 374/744] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:55 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:55.972218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:55.972731 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:56.124576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:56.132576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6416ac50-a47a-4766-ba4f-0c93d31b5a4a tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.178226 Aug 09 19:19:56.133195 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 371/745] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:55 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:56.979641 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:56.980285 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:56.987747 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:56.988235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:56.989080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:56.989972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:56.990412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:56.990841 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:57.147197 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:57.154684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:57.155383 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:57.156010 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:57.157635 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:57.162822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:57.163514 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:57.164058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:57.168400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6e1a2088-26b1-40e8-bb29-eca2a9c24279 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.183508 Aug 09 19:19:57.169297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 375/746] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:56 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:57.170306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:57.171154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:57.171599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:57.335041 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:57.343066 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-7adb367f-bebe-4edd-bb43-6dcd6e510f9b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.192135 Aug 09 19:19:57.343640 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 372/747] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:57 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:19:58.192387 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:58.193757 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:58.201058 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:58.201921 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:58.202706 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:58.203710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:58.204472 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:58.205191 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:58.349576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:58.359245 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:58.360794 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:58.361972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-12f412c4-40c4-494d-9d87-e4dc7df87047 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.173502 Aug 09 19:19:58.364513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 376/748] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:58 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:58.365037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:58.365740 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:58.373322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:58.373813 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:58.374345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:58.375171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:58.375628 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:58.376242 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:58.527824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:58.536914 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3cac313b-1e69-43e4-8970-54ba15ecc878 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.175310 Aug 09 19:19:58.537588 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 373/749] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:58 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:19:59.385627 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:59.386388 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:59.393998 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:59.393998 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:59.394377 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:59.395075 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:59.395525 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:59.395948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:59.548174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:59.557017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:59.558973 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:59.560233 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-faa58e33-6d46-4238-83fa-9c4530305411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.178742 Aug 09 19:19:59.560941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:19:59.562384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:19:59.564840 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 377/750] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:19:59 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:19:59.570133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:59.570846 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:59.571355 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:59.572130 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:19:59.572811 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:19:59.573305 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:19:59.717449 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:19:59.725077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-350bde97-f381-4519-b572-b27160854a39 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.168118 Aug 09 19:19:59.725637 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 374/751] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:19:59 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:20:00.583364 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:00.583961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:00.590953 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:00.591425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:00.591847 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:00.592547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:00.592989 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:00.593402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:00.722139 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:00.730073 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:00.731594 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:00.732800 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-09c5668d-5cb6-4b2c-9003-15421bb0d08f tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.153341 Aug 09 19:20:00.733363 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 378/752] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:00 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:00.746689 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:00.747384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:00.749915 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:00.755031 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:00.755509 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:00.755939 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:00.756655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:00.757742 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:00.758172 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:00.888792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:00.896597 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9efcb422-8468-4538-8d8a-ae5087f7d66b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.153636 Aug 09 19:20:00.897103 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 375/753] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:00 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:01.756058 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:01.756721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:01.763837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:01.764291 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:01.764744 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:01.765424 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:01.765867 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:01.766281 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:01.892445 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:01.900926 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:01.902409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:01.903572 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0e28741e-c21b-4ee5-a777-a871f28088a3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.151386 Aug 09 19:20:01.904127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 379/754] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:01 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:01.918336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:01.918984 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:01.925900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:01.926384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:01.926817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:01.927509 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:01.927959 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:01.928381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:02.063557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:02.071754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9ccab69e-0058-4451-a454-eb175d99d669 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.157563 Aug 09 19:20:02.072316 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 376/755] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:01 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:02.926320 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:02.926957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:02.934376 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:02.934863 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:02.935291 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:02.935981 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:02.936428 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:02.936879 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:03.076705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:03.084652 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:03.086257 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:03.087397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-16f08056-866e-461f-802b-78cf08cb0f69 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.165061 Aug 09 19:20:03.088128 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 380/756] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:02 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:03.093575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:03.094193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:03.100747 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:03.101576 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:03.102083 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:03.102781 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:03.103236 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:03.103670 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:03.287194 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:03.295344 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2717c6c2-6735-4a78-9912-a50f03168a77 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1579 microversion: 2.1 time: 0.205650 Aug 09 19:20:03.296171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 377/757] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:03 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1579 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:04.109947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:04.110560 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:04.112909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:04.119316 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:04.119968 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:04.120511 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:04.121303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:04.121752 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:04.122387 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:04.265586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:04.276706 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:04.278388 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:04.279831 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ce294e77-0116-45c8-b5e9-7b1190c73154 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.173992 Aug 09 19:20:04.280405 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 381/758] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:04 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:04.316960 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:04.317582 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:04.325408 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:04.325889 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:04.326320 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:04.327014 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:04.327463 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:04.327884 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:04.397332 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:04.405616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-cfb10a33-ec2e-4780-ba59-1a4a19dc0544 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 200 len: 1511 microversion: 2.1 time: 0.092491 Aug 09 19:20:04.406193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 378/759] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:04 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 1511 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:04.571994 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-80833433-f834-4f55-bd60-d139fd3a81a5 req-2a57141f-83e9-44b1-b486-2280c895cd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c627b1d-06ef-4702-9080-ee169c06437e", "name": "network-vif-deleted", "tag": "1d0cc0a5-e01b-4194-b532-bc2554cfbc71"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:04.581706 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-80833433-f834-4f55-bd60-d139fd3a81a5 req-2a57141f-83e9-44b1-b486-2280c895cd0c service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:04.582174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-80833433-f834-4f55-bd60-d139fd3a81a5 req-2a57141f-83e9-44b1-b486-2280c895cd0c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:04.582862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-80833433-f834-4f55-bd60-d139fd3a81a5 req-2a57141f-83e9-44b1-b486-2280c895cd0c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:04.605936 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-80833433-f834-4f55-bd60-d139fd3a81a5 req-2a57141f-83e9-44b1-b486-2280c895cd0c service nova] Creating event network-vif-deleted:1d0cc0a5-e01b-4194-b532-bc2554cfbc71 for instance 1c627b1d-06ef-4702-9080-ee169c06437e on hv-cinder-85265 Aug 09 19:20:04.611710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-80833433-f834-4f55-bd60-d139fd3a81a5 req-2a57141f-83e9-44b1-b486-2280c895cd0c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044309 Aug 09 19:20:04.612912 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 382/760] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:05.303176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:05.304638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:05.310663 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:05.311153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:05.311592 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:05.312295 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:05.312786 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:05.313213 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:05.434610 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:05.435550 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:05.442878 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:05.443369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:05.443805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:05.445172 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:05.446107 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:05.446698 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:05.464129 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] HTTP exception thrown: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Request method failure captured: Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e HTTP/1.1 Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rKjR7kColiTVRyWo1F4ylw4TXQgm3y77D4BXnZRqwN8ZKqYLaLJ2Z9XV45s79_d4uR0dXTMNZZhJECb7QHr3LhoQJMPJv1Jdl0iEGOH5fvkoEkZc8e8cSyKKH25LoO-BH4boNUsuIB7KVa7a2ejCGn-VcUWTrPGbsmQcKvO5NBB7g4 Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:20:05.465862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_faf0c6e98206493ea25654f44c9ae563"}]}] Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-TestVolumeBootPattern-77167014 Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: f12cfb692b4b4947bc67a3199aa33e73 Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:20:05.467337 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': '1c627b1d-06ef-4702-9080-ee169c06437e'} Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:05.468170 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:20:05.469542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:05.470693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Returning 404 to user: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:05.470693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-079d72ea-63d4-4ae7-97bc-63b1d6005358 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 404 len: 111 microversion: 2.1 time: 0.037524 Aug 09 19:20:05.476695 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:05.477101 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 383/761] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:05 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:20:05.485980 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:05.487661 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:05.489981 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-12b3fa3a-3a7b-487b-a05e-9973fc1b99d0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.189978 Aug 09 19:20:05.490557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 379/762] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:05 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:05.571188 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-179340365", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-205325892", "security_groups": [{"name": "tempest-secgroup-smoke-1182586383"}], "block_device_mapping_v2": [{"uuid": "be35cdf9-d07a-4a94-b48e-8bf01877fd80", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b9e53f99-225a-4b2a-8235-02ef2f63b2e3"}]}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:05.688567 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] validate_networks() for [('b9e53f99-225a-4b2a-8235-02ef2f63b2e3', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:20:06.065833 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:20:06.066249 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:20:06.066715 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:20:06.067115 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:20:06.067516 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:20:06.076758 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:06.077234 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:06.077656 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:06.078435 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:06.078902 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:06.079403 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:06.097051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Getting quotas for project faf0c6e98206493ea25654f44c9ae563. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:20:06.102336 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Getting quotas for user f12cfb692b4b4947bc67a3199aa33e73 and project faf0c6e98206493ea25654f44c9ae563. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:20:06.162547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:20:06.165460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be35cdf9-d07a-4a94-b48e-8bf01877fd80',volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:20:06.294720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a4b1d145-db6b-4925-9d90-463dec4c2999 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728816 Aug 09 19:20:06.295536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 384/763] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:20:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:20:06.306480 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0e10ae08-54a6-46ad-9666-334da9a16fdb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:06.307132 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0e10ae08-54a6-46ad-9666-334da9a16fdb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:06.360473 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-0e10ae08-54a6-46ad-9666-334da9a16fdb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:06.367303 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0e10ae08-54a6-46ad-9666-334da9a16fdb tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1093 microversion: 2.1 time: 0.064789 Aug 09 19:20:06.368051 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 380/764] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:06 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:06.514996 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:06.515656 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:06.523191 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:06.524029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:06.524621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:06.525378 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:06.525791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:06.526218 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:06.663405 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:06.673247 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:06.674772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:06.675939 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-fb3a218b-8702-4fbc-a515-e12241405d0a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.165518 Aug 09 19:20:06.676521 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 385/765] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:06 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:07.390995 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:07.393295 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:07.402727 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:07.403375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:07.403888 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:07.404712 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:07.405238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:07.405757 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:07.422943 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:07.511387 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:07.524859 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1d731913-7a77-46d7-a0b4-715264bf50c2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1209 microversion: 2.1 time: 0.139736 Aug 09 19:20:07.525446 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 381/766] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:07 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:07.700086 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:07.701196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:07.716888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:07.717727 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:07.718171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:07.718879 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:07.719331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:07.719763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:07.841193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-0d979541-fad6-414d-b306-4463fd64d146 req-4a7e874b-0f6d-476e-aeb1-e3300f741ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fa3b0c-4952-4132-9fae-7b242fb393f5", "name": "network-vif-plugged", "status": "completed", "tag": "422e722d-30ec-4f63-8a1b-d4c21996173d"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:07.855701 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-0d979541-fad6-414d-b306-4463fd64d146 req-4a7e874b-0f6d-476e-aeb1-e3300f741ad4 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:07.860564 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-0d979541-fad6-414d-b306-4463fd64d146 req-4a7e874b-0f6d-476e-aeb1-e3300f741ad4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:07.861239 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-0d979541-fad6-414d-b306-4463fd64d146 req-4a7e874b-0f6d-476e-aeb1-e3300f741ad4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:07.891372 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-0d979541-fad6-414d-b306-4463fd64d146 req-4a7e874b-0f6d-476e-aeb1-e3300f741ad4 service nova] Creating event network-vif-plugged:422e722d-30ec-4f63-8a1b-d4c21996173d for instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 on hv-cinder-85265 Aug 09 19:20:07.900850 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-0d979541-fad6-414d-b306-4463fd64d146 req-4a7e874b-0f6d-476e-aeb1-e3300f741ad4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064058 Aug 09 19:20:07.901856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 382/767] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:07.925375 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:07.930336 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:07.939773 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:07.943518 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:07.946748 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3b680568-27e6-4815-b856-c705563f3fa5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.250041 Aug 09 19:20:07.960021 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 386/768] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:07 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:08.547853 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:08.549456 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:08.557212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:08.557643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:08.558091 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:08.558828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:08.559284 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:08.559709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:08.765166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-d34df343-ecec-41d1-b812-3efddf668721 req-2df9402c-0639-44ba-8444-dbc02347d4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51acc754-aaff-495f-9744-829f6b8d04b1", "tag": "43a7588e-3e32-4ee3-867c-c35301d5c546"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:08.766994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:08.775042 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c1d3dd34-d0e4-43c9-b9b6-c17da6d84641 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.232928 Aug 09 19:20:08.775628 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 383/769] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:08 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:08.777244 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d34df343-ecec-41d1-b812-3efddf668721 req-2df9402c-0639-44ba-8444-dbc02347d4aa service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:08.778017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d34df343-ecec-41d1-b812-3efddf668721 req-2df9402c-0639-44ba-8444-dbc02347d4aa service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:08.778624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d34df343-ecec-41d1-b812-3efddf668721 req-2df9402c-0639-44ba-8444-dbc02347d4aa service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:08.791933 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-d34df343-ecec-41d1-b812-3efddf668721 req-2df9402c-0639-44ba-8444-dbc02347d4aa service nova] Creating event network-changed:43a7588e-3e32-4ee3-867c-c35301d5c546 for instance 51acc754-aaff-495f-9744-829f6b8d04b1 on hv-cinder-85265 Aug 09 19:20:08.797004 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-d34df343-ecec-41d1-b812-3efddf668721 req-2df9402c-0639-44ba-8444-dbc02347d4aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036068 Aug 09 19:20:08.797757 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 387/770] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:20:08.972066 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:08.972764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:08.979232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:08.979710 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:08.980136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:08.980841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:08.981286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:08.981710 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:09.198495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:09.207614 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:09.209179 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:09.211123 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1254e3b9-2899-40db-85c8-97903c35c85a tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1731 microversion: 2.20 time: 0.242886 Aug 09 19:20:09.211804 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 384/771] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:08 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:09.798889 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:09.799800 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:09.806311 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:09.806803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:09.807241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:09.807948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:09.808400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:09.808852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:09.946171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:09.954131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-aa1cd8e9-b181-486e-b46a-c58b9eb8e21d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.160311 Aug 09 19:20:09.954647 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 388/772] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:09 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:10.235311 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:10.235925 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:10.243175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:10.243685 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:10.244113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:10.244849 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:10.245320 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:10.245730 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:10.437715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:10.446693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:10.448197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:10.449392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2552c3f6-8861-4ba7-9a1f-9edb97c21bd5 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1718 microversion: 2.20 time: 0.218163 Aug 09 19:20:10.449955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 385/773] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:10 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1718 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:10.975061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:10.976358 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:10.982952 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:10.983437 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:10.983872 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:10.984588 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:10.985044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:10.985463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:11.119135 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:11.126613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6cba4050-cfd5-48c2-81c9-740bfc69dc98 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.155401 Aug 09 19:20:11.127185 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 389/774] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:10 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:12.148460 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:12.149092 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:12.155521 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:12.156007 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:12.156461 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:12.157162 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:12.157621 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:12.158056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:12.289779 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:12.297667 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-23f10557-c449-407b-b96f-2ff5919582cc tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.153970 Aug 09 19:20:12.298238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 386/775] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:12 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:12.911253 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-aad1dbb6-4fd1-4c96-bd9a-eb7e284608a4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:12.911843 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-aad1dbb6-4fd1-4c96-bd9a-eb7e284608a4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:12.918269 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aad1dbb6-4fd1-4c96-bd9a-eb7e284608a4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:12.918779 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aad1dbb6-4fd1-4c96-bd9a-eb7e284608a4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:12.919837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aad1dbb6-4fd1-4c96-bd9a-eb7e284608a4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:12.919954 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aad1dbb6-4fd1-4c96-bd9a-eb7e284608a4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:12.920355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aad1dbb6-4fd1-4c96-bd9a-eb7e284608a4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:12.921068 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aad1dbb6-4fd1-4c96-bd9a-eb7e284608a4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:12.944996 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-aad1dbb6-4fd1-4c96-bd9a-eb7e284608a4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/ips" status: 200 len: 149 microversion: 2.1 time: 0.036955 Aug 09 19:20:12.945553 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 390/776] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:20:12 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:13.317705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:13.318321 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:13.324852 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:13.325333 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:13.325772 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:13.326458 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:13.326908 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:13.327441 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:13.478205 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:13.487706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-56a1c5c7-c945-4bf5-bb9a-023ae1acafa6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.173895 Aug 09 19:20:13.488281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 387/777] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:13 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:14.324195 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d98dbabd-4b53-46d0-94b0-adf9b991a5ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17c62481-bf0b-4d7a-a1c3-af6f36894ee2"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:14.326617 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d98dbabd-4b53-46d0-94b0-adf9b991a5ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:14.333227 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d98dbabd-4b53-46d0-94b0-adf9b991a5ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:14.333712 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d98dbabd-4b53-46d0-94b0-adf9b991a5ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:14.334146 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d98dbabd-4b53-46d0-94b0-adf9b991a5ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:14.335466 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d98dbabd-4b53-46d0-94b0-adf9b991a5ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:14.336005 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d98dbabd-4b53-46d0-94b0-adf9b991a5ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:14.336459 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d98dbabd-4b53-46d0-94b0-adf9b991a5ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:14.509557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:14.510156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:14.516760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:14.517300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:14.517806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:14.518591 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:14.519009 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:14.519423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:14.588021 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d98dbabd-4b53-46d0-94b0-adf9b991a5ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267629 Aug 09 19:20:14.589213 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 391/778] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:20:14 2022] POST /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:14.662440 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:14.670075 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a4714460-4708-40f5-86fa-4fc192a31f99 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.164790 Aug 09 19:20:14.671102 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 388/779] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:14 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:20:15.692253 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:15.692982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:15.699792 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:15.700267 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:15.700725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:15.701408 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:15.701849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:15.702354 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:15.839567 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:15.847162 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c151e920-3104-4327-ae68-b683a1468f31 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.159905 Aug 09 19:20:15.847729 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 392/780] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:15 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:16.868973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:16.869572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:16.871998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:16.877770 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:16.878256 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:16.878690 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:16.879382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:16.879834 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:16.880264 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:17.015221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:17.022730 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-87b20aa1-08ca-48a7-bd1e-07194c4373b3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.158320 Aug 09 19:20:17.023295 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 389/781] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:16 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:18.044069 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:18.044687 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:18.047287 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:18.047958 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=6 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:18.054192 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:18.054693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:18.055129 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:18.055826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:18.056313 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:18.056772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:18.186401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:18.193909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8041aba6-0ae7-4f94-91f5-34fe0647bf3d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.153783 Aug 09 19:20:18.194481 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 393/782] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:18 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:20:18.607923 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-7362ffc6-2fb6-4aa4-827c-2237cd62eb69 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:18.608505 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-7362ffc6-2fb6-4aa4-827c-2237cd62eb69 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:18.614942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7362ffc6-2fb6-4aa4-827c-2237cd62eb69 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:18.615424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7362ffc6-2fb6-4aa4-827c-2237cd62eb69 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:18.616375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7362ffc6-2fb6-4aa4-827c-2237cd62eb69 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:18.617384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7362ffc6-2fb6-4aa4-827c-2237cd62eb69 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:18.617842 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7362ffc6-2fb6-4aa4-827c-2237cd62eb69 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:18.618272 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7362ffc6-2fb6-4aa4-827c-2237cd62eb69 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:18.641606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-7362ffc6-2fb6-4aa4-827c-2237cd62eb69 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/ips" status: 200 len: 145 microversion: 2.1 time: 0.037481 Aug 09 19:20:18.642099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 390/783] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:20:18 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:19.214958 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:19.215573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:19.221968 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:19.222448 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:19.222879 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:19.223566 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:19.224019 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:19.224462 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:19.586905 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:19.594322 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e8f81a38-60f1-49b5-8e49-c9576e1c2757 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.383289 Aug 09 19:20:19.594882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 394/784] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:19 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:19.982738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a859c6ee-bb7d-4aba-a402-de9a64595e07 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92e14505-0cdd-40e8-b595-668970c1219f"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:19.985294 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a859c6ee-bb7d-4aba-a402-de9a64595e07 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:19.991974 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a859c6ee-bb7d-4aba-a402-de9a64595e07 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:19.992491 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a859c6ee-bb7d-4aba-a402-de9a64595e07 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:19.992931 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a859c6ee-bb7d-4aba-a402-de9a64595e07 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:19.993627 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a859c6ee-bb7d-4aba-a402-de9a64595e07 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:19.994078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a859c6ee-bb7d-4aba-a402-de9a64595e07 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:19.994500 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a859c6ee-bb7d-4aba-a402-de9a64595e07 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:20.364115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a859c6ee-bb7d-4aba-a402-de9a64595e07 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385343 Aug 09 19:20:20.370663 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 391/785] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:20:19 2022] POST /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:20:20.614928 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:20.615613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:20.622842 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:20.623319 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:20.623748 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:20.624578 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:20.625094 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:20.625515 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:20.759111 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:20.766908 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-aaa8b1f8-6e24-4773-96f6-2ad8a3766f19 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.155795 Aug 09 19:20:20.767480 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 395/786] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:20 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:21.788470 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:21.789171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:21.795297 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:21.796049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:21.796583 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:21.797288 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:21.797735 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:21.798161 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:21.935865 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-98695e25-d9b5-44a1-b95d-3c17ec0d9ce5 req-c1d1c34b-6a58-4e26-b717-37fed104f9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51acc754-aaff-495f-9744-829f6b8d04b1", "name": "network-vif-plugged", "status": "completed", "tag": "43a7588e-3e32-4ee3-867c-c35301d5c546"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:21.943007 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:21.948904 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-98695e25-d9b5-44a1-b95d-3c17ec0d9ce5 req-c1d1c34b-6a58-4e26-b717-37fed104f9a4 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:21.949803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-98695e25-d9b5-44a1-b95d-3c17ec0d9ce5 req-c1d1c34b-6a58-4e26-b717-37fed104f9a4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:21.950248 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-98695e25-d9b5-44a1-b95d-3c17ec0d9ce5 req-c1d1c34b-6a58-4e26-b717-37fed104f9a4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:21.951929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6dc7e6c1-7d9c-49f4-860e-944860c3f249 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.168201 Aug 09 19:20:21.952656 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 392/787] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:21 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:21.966570 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-98695e25-d9b5-44a1-b95d-3c17ec0d9ce5 req-c1d1c34b-6a58-4e26-b717-37fed104f9a4 service nova] Creating event network-vif-plugged:43a7588e-3e32-4ee3-867c-c35301d5c546 for instance 51acc754-aaff-495f-9744-829f6b8d04b1 on hv-cinder-85265 Aug 09 19:20:21.971356 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-98695e25-d9b5-44a1-b95d-3c17ec0d9ce5 req-c1d1c34b-6a58-4e26-b717-37fed104f9a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039695 Aug 09 19:20:21.971967 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 396/788] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:20:22.137177 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ee140d78-b672-4ebb-952a-dbb7bd6a70ae tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: .version_select at 0x7fa50371b3a0>, body: {"keypair": {"name": "tempest-keypair-1744353413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNY2+cPIv2IbpFa7XgdD1qdbI0l88bTw0ezteDjd35FSxRDMvMhLb9wwmVAaRNxnXaJliDO6o3ViTk0TZEMzdwpZIXRkvraE9AIq9glAxNKoZ67soHFeS5xqd9N/iZhiZA=="}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:22.152996 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-ee140d78-b672-4ebb-952a-dbb7bd6a70ae tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for project 46afad886ad34608b533f4ee80a18ba5. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:20:22.157007 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-ee140d78-b672-4ebb-952a-dbb7bd6a70ae tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for user 4f7899ab15b347b7be75e3433f0d5450 and project 46afad886ad34608b533f4ee80a18ba5. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:20:22.180583 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ee140d78-b672-4ebb-952a-dbb7bd6a70ae tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047615 Aug 09 19:20:22.181182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 393/789] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:20:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:20:22.974007 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:22.974699 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:22.982153 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:22.982648 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:22.983066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:22.983753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:22.984737 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:22.985474 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:23.132293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:23.141299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-169eec16-22c8-4c17-96c5-01dc1461e185 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1265 microversion: 2.1 time: 0.171793 Aug 09 19:20:23.141879 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 397/790] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:22 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:23.500902 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1755371638", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f05d1eed-0f4c-4655-a75a-07649579d361"}], "security_groups": [{"name": "tempest-securitygroup--1983380095"}], "key_name": "tempest-keypair-1744353413", "user_data": "}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:23.618195 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] validate_networks() for [('f05d1eed-0f4c-4655-a75a-07649579d361', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:20:24.043561 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:20:24.044010 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:20:24.044510 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:20:24.044923 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:20:24.045595 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:20:24.055142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:24.055654 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:24.056088 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:24.056892 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:24.057344 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:24.057769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:24.077315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for project 46afad886ad34608b533f4ee80a18ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:20:24.081501 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for user 4f7899ab15b347b7be75e3433f0d5450 and project 46afad886ad34608b533f4ee80a18ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:20:24.093163 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:20:24.095423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:20:24.143461 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2d5b3bce-b645-4b64-ab0a-2f8c54d26c91 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647456 Aug 09 19:20:24.144465 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 394/791] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:20:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:20:24.157972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f1b807ab-b1db-4400-b258-36cb8fb225ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:24.158582 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f1b807ab-b1db-4400-b258-36cb8fb225ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:24.161700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:24.162315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:24.169286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:24.169774 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:24.170206 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:24.171175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:24.171687 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:24.172105 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:24.229398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f1b807ab-b1db-4400-b258-36cb8fb225ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:24.236961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f1b807ab-b1db-4400-b258-36cb8fb225ef tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1242 microversion: 2.1 time: 0.082835 Aug 09 19:20:24.237551 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 398/792] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:24 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:24.321175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:24.328773 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-78a5f620-97ad-449f-afe8-bb4b88e86399 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1452 microversion: 2.1 time: 0.170841 Aug 09 19:20:24.329334 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 395/793] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:24 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:20:24.349552 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:24.350460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:24.359862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:24.360350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:24.360944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:24.361641 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:24.362092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:24.362511 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:24.519019 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:24.529363 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2cc96af9-ffcd-490a-b84a-c8f205277bfe tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1452 microversion: 2.1 time: 0.183871 Aug 09 19:20:24.530245 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 399/794] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:24 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:25.261721 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:25.263245 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:25.270340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:25.270829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:25.271613 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:25.273246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:25.273877 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:25.274704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:25.372946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:25.383083 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-442e7eb2-7c75-408a-8f24-4f23ada81ae9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1312 microversion: 2.1 time: 0.127692 Aug 09 19:20:25.397171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 396/795] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:25 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1312 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:26.408775 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:26.409574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:26.416558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:26.417049 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:26.417481 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:26.418177 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:26.418629 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:26.419051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:26.564590 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:26.575123 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-43f2e5a6-0ff0-49fa-bb39-ec77e43d4556 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1368 microversion: 2.1 time: 0.172882 Aug 09 19:20:26.589843 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 400/796] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:26 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:27.596764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:27.596764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:27.609343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:27.610288 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:27.611340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:27.612470 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:27.613037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:27.614495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:27.728079 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-c375d18e-148c-4aa4-a212-f0bb1d07e5dc req-8cec4439-a7e5-41ee-aa64-31875766608c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51acc754-aaff-495f-9744-829f6b8d04b1", "tag": "43a7588e-3e32-4ee3-867c-c35301d5c546"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:27.739858 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c375d18e-148c-4aa4-a212-f0bb1d07e5dc req-8cec4439-a7e5-41ee-aa64-31875766608c service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:27.740324 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c375d18e-148c-4aa4-a212-f0bb1d07e5dc req-8cec4439-a7e5-41ee-aa64-31875766608c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:27.740852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-c375d18e-148c-4aa4-a212-f0bb1d07e5dc req-8cec4439-a7e5-41ee-aa64-31875766608c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:27.752593 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-c375d18e-148c-4aa4-a212-f0bb1d07e5dc req-8cec4439-a7e5-41ee-aa64-31875766608c service nova] Creating event network-changed:43a7588e-3e32-4ee3-867c-c35301d5c546 for instance 51acc754-aaff-495f-9744-829f6b8d04b1 on hv-cinder-85265 Aug 09 19:20:27.758000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-c375d18e-148c-4aa4-a212-f0bb1d07e5dc req-8cec4439-a7e5-41ee-aa64-31875766608c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034498 Aug 09 19:20:27.758975 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 401/797] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:27.985835 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5b0d5ae2-bc11-42ff-b4ec-91fb060b67ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:27.992398 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5b0d5ae2-bc11-42ff-b4ec-91fb060b67ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:28.000770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5b0d5ae2-bc11-42ff-b4ec-91fb060b67ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:28.001634 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5b0d5ae2-bc11-42ff-b4ec-91fb060b67ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:28.002501 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5b0d5ae2-bc11-42ff-b4ec-91fb060b67ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:28.003740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5b0d5ae2-bc11-42ff-b4ec-91fb060b67ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:28.004390 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5b0d5ae2-bc11-42ff-b4ec-91fb060b67ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:28.005071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5b0d5ae2-bc11-42ff-b4ec-91fb060b67ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:28.052808 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5b0d5ae2-bc11-42ff-b4ec-91fb060b67ff tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071479 Aug 09 19:20:28.060880 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 402/798] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:20:27 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:20:28.065904 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-cd453166-4575-4e77-af24-383f56a50c2a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:28.066430 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-cd453166-4575-4e77-af24-383f56a50c2a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:28.074586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cd453166-4575-4e77-af24-383f56a50c2a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:28.075346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cd453166-4575-4e77-af24-383f56a50c2a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:28.075938 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cd453166-4575-4e77-af24-383f56a50c2a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:28.076835 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cd453166-4575-4e77-af24-383f56a50c2a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:28.077551 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cd453166-4575-4e77-af24-383f56a50c2a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:28.078147 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cd453166-4575-4e77-af24-383f56a50c2a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:28.112936 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-cd453166-4575-4e77-af24-383f56a50c2a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/92e14505-0cdd-40e8-b595-668970c1219f" status: 200 len: 194 microversion: 2.1 time: 0.050644 Aug 09 19:20:28.114044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 403/799] 10.222.0.70 () {58 vars in 1413 bytes} [Tue Aug 9 19:20:28 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/92e14505-0cdd-40e8-b595-668970c1219f => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:28.121553 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:28.141278 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d8ab11ca-8846-44c3-b83d-5851df1698c4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1368 microversion: 2.1 time: 0.548106 Aug 09 19:20:28.141676 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 397/800] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:27 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1368 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:29.163754 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:29.164373 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:29.171009 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:29.171479 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:29.171903 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:29.172605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:29.173048 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:29.173459 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:29.311425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:29.319032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0e63bf83-d75d-42bb-abcc-b85985e474bc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1368 microversion: 2.1 time: 0.159691 Aug 09 19:20:29.319942 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 404/801] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:29 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:29.638416 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c6e221b1-1707-4309-89ec-14d2d97c637f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7d03e13-2142-4802-8511-62802a73d248"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:29.640878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c6e221b1-1707-4309-89ec-14d2d97c637f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:29.648100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6e221b1-1707-4309-89ec-14d2d97c637f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:29.648658 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6e221b1-1707-4309-89ec-14d2d97c637f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:29.649097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6e221b1-1707-4309-89ec-14d2d97c637f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:29.649792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6e221b1-1707-4309-89ec-14d2d97c637f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:29.650244 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6e221b1-1707-4309-89ec-14d2d97c637f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:29.650669 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c6e221b1-1707-4309-89ec-14d2d97c637f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:29.774740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-89942fd7-e34e-4281-aff7-f8c65b1f9b3a req-adbf52c0-9e25-4bb0-902e-5db1cef3ccaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8480c7c-419e-4968-9b71-1e79ad47a8f1", "tag": "c3241f3a-4a9b-4d8f-8773-219c6d06fbba"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:29.779673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:29.784574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-89942fd7-e34e-4281-aff7-f8c65b1f9b3a req-adbf52c0-9e25-4bb0-902e-5db1cef3ccaf service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:29.785342 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-89942fd7-e34e-4281-aff7-f8c65b1f9b3a req-adbf52c0-9e25-4bb0-902e-5db1cef3ccaf service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:29.785803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-89942fd7-e34e-4281-aff7-f8c65b1f9b3a req-adbf52c0-9e25-4bb0-902e-5db1cef3ccaf service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:29.798813 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-89942fd7-e34e-4281-aff7-f8c65b1f9b3a req-adbf52c0-9e25-4bb0-902e-5db1cef3ccaf service nova] Creating event network-changed:c3241f3a-4a9b-4d8f-8773-219c6d06fbba for instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 on hv-cinder-85265 Aug 09 19:20:29.806305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-89942fd7-e34e-4281-aff7-f8c65b1f9b3a req-adbf52c0-9e25-4bb0-902e-5db1cef3ccaf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036194 Aug 09 19:20:29.807023 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 405/802] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:20:29.900808 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c6e221b1-1707-4309-89ec-14d2d97c637f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "POST /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266251 Aug 09 19:20:29.901861 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 398/803] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:20:29 2022] POST /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:30.340535 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:30.341223 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:30.347809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:30.348286 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:30.348748 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:30.349488 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:30.350474 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:30.350885 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:30.355120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:30.486304 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:30.494692 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-386c79fd-fae1-4d9c-a80a-c7fb727551a3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1368 microversion: 2.1 time: 0.158396 Aug 09 19:20:30.495262 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 406/804] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:30 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:31.516602 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:31.517318 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:31.519717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:31.525461 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:31.525978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:31.526412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:31.527107 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:31.527559 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:31.527984 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:31.662635 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:31.670546 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a787d22e-45d7-470d-ba3b-f5bcaa722e04 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1368 microversion: 2.1 time: 0.157811 Aug 09 19:20:31.670919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 399/805] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:31 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:32.691513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:32.692127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:32.698957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:32.699440 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:32.699880 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:32.700615 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:32.701067 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:32.701491 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:32.831544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:32.839174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f39b15d7-c557-46d7-beee-11e5b175b43f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1368 microversion: 2.1 time: 0.151588 Aug 09 19:20:32.839761 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 407/806] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:32 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:32.904176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-472142308"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:32.904779 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:32.911182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:32.911661 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:32.912090 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:32.913732 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:32.914183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:32.914607 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:33.046146 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.network.security_group_api [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Removing security group 6acffbf8-10e9-40c2-b237-9703ee4cf77b from port 7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df Aug 09 19:20:33.372606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6cdd7b45-a8db-44a6-96ba-3ed911135937 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "POST /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/action" status: 202 len: 0 microversion: 2.1 time: 0.472292 Aug 09 19:20:33.373521 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 400/807] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:20:32 2022] POST /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:20:33.395741 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-6474d008-e1dc-45dc-bdda-f22bfbd1d005 req-f42cdddd-4b7c-4db8-b653-15e0e6f492e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a38bc60-9e78-4799-a3dc-b5d706eb4aa8", "tag": "7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:33.407029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-6474d008-e1dc-45dc-bdda-f22bfbd1d005 req-f42cdddd-4b7c-4db8-b653-15e0e6f492e9 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:33.407792 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-6474d008-e1dc-45dc-bdda-f22bfbd1d005 req-f42cdddd-4b7c-4db8-b653-15e0e6f492e9 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:33.408373 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-6474d008-e1dc-45dc-bdda-f22bfbd1d005 req-f42cdddd-4b7c-4db8-b653-15e0e6f492e9 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:33.425008 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-6474d008-e1dc-45dc-bdda-f22bfbd1d005 req-f42cdddd-4b7c-4db8-b653-15e0e6f492e9 service nova] Creating event network-changed:7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df for instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 on hv-cinder-85265 Aug 09 19:20:33.431071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-6474d008-e1dc-45dc-bdda-f22bfbd1d005 req-f42cdddd-4b7c-4db8-b653-15e0e6f492e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049589 Aug 09 19:20:33.432458 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 408/808] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:33.860225 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:33.860893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:33.869527 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:33.870024 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:33.870464 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:33.871180 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:33.871636 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:33.872059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:34.065488 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:34.089001 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=10 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:34.094078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:34.103433 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f7623336-de12-49de-95c6-69407b3cceaa tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1368 microversion: 2.1 time: 0.247061 Aug 09 19:20:34.104293 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 401/809] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:33 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:34.119769 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-4fda676f-47d8-423e-b729-1a300e12e589 req-df76b6c2-94f6-4116-a012-50b02ab3e910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8480c7c-419e-4968-9b71-1e79ad47a8f1", "name": "network-vif-plugged", "status": "completed", "tag": "c3241f3a-4a9b-4d8f-8773-219c6d06fbba"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:34.127391 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:34.132792 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4fda676f-47d8-423e-b729-1a300e12e589 req-df76b6c2-94f6-4116-a012-50b02ab3e910 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:34.133512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4fda676f-47d8-423e-b729-1a300e12e589 req-df76b6c2-94f6-4116-a012-50b02ab3e910 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:34.133930 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4fda676f-47d8-423e-b729-1a300e12e589 req-df76b6c2-94f6-4116-a012-50b02ab3e910 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:34.147253 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-4fda676f-47d8-423e-b729-1a300e12e589 req-df76b6c2-94f6-4116-a012-50b02ab3e910 service nova] Creating event network-vif-plugged:c3241f3a-4a9b-4d8f-8773-219c6d06fbba for instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 on hv-cinder-85265 Aug 09 19:20:34.153339 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-4fda676f-47d8-423e-b729-1a300e12e589 req-df76b6c2-94f6-4116-a012-50b02ab3e910 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038088 Aug 09 19:20:34.154514 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 409/810] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:34.501779 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:34.502281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:34.504626 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-3d1e3ce7-8c79-40a2-939b-a1d9a6912aa3 req-5e30d185-efc4-42b4-afd2-ae815db0bf83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a38bc60-9e78-4799-a3dc-b5d706eb4aa8", "tag": "7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:34.510020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:34.510516 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:34.510953 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:34.511843 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:34.512478 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:34.512921 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:34.513073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:34.518032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-3d1e3ce7-8c79-40a2-939b-a1d9a6912aa3 req-5e30d185-efc4-42b4-afd2-ae815db0bf83 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:34.518834 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-3d1e3ce7-8c79-40a2-939b-a1d9a6912aa3 req-5e30d185-efc4-42b4-afd2-ae815db0bf83 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:34.519485 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-3d1e3ce7-8c79-40a2-939b-a1d9a6912aa3 req-5e30d185-efc4-42b4-afd2-ae815db0bf83 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:34.531090 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-3d1e3ce7-8c79-40a2-939b-a1d9a6912aa3 req-5e30d185-efc4-42b4-afd2-ae815db0bf83 service nova] Creating event network-changed:7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df for instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 on hv-cinder-85265 Aug 09 19:20:34.537358 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-3d1e3ce7-8c79-40a2-939b-a1d9a6912aa3 req-5e30d185-efc4-42b4-afd2-ae815db0bf83 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036579 Aug 09 19:20:34.538586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 410/811] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:20:34.606808 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lazy-loading 'services' on Instance uuid 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:20:34.683614 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fe150bb7-20bb-44e2-a740-d70f182e3d2f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments/4929b3b6-f59f-47a0-a533-1b7b43f0b78f" status: 202 len: 0 microversion: 2.1 time: 0.185866 Aug 09 19:20:34.688861 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 402/812] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:20:34 2022] DELETE /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments/4929b3b6-f59f-47a0-a533-1b7b43f0b78f => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:20:34.697314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-109dc6be-8b72-4d8b-94e3-5c7232c0b48e tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:34.701029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-109dc6be-8b72-4d8b-94e3-5c7232c0b48e tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:34.708230 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-109dc6be-8b72-4d8b-94e3-5c7232c0b48e tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:34.710849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-109dc6be-8b72-4d8b-94e3-5c7232c0b48e tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:34.711672 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-109dc6be-8b72-4d8b-94e3-5c7232c0b48e tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:34.712898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-109dc6be-8b72-4d8b-94e3-5c7232c0b48e tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:34.713766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-109dc6be-8b72-4d8b-94e3-5c7232c0b48e tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:34.714210 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-109dc6be-8b72-4d8b-94e3-5c7232c0b48e tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:34.752727 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-109dc6be-8b72-4d8b-94e3-5c7232c0b48e tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062149 Aug 09 19:20:34.753302 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 411/813] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:20:34 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:35.128698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:35.129318 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:35.136431 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:35.136943 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:35.137374 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:35.138096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:35.138546 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:35.138962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:35.345389 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:35.354425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-7db6e4fc-7a30-45fe-970d-258c19f25833 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1368 microversion: 2.1 time: 0.229959 Aug 09 19:20:35.355021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 403/814] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:35 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:35.766527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-29a22a92-5af6-4aed-845b-e6bce95320bc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:35.768725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-29a22a92-5af6-4aed-845b-e6bce95320bc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:35.775090 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-29a22a92-5af6-4aed-845b-e6bce95320bc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:35.775562 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-29a22a92-5af6-4aed-845b-e6bce95320bc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:35.775991 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-29a22a92-5af6-4aed-845b-e6bce95320bc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:35.776705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-29a22a92-5af6-4aed-845b-e6bce95320bc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:35.777145 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-29a22a92-5af6-4aed-845b-e6bce95320bc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:35.777555 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-29a22a92-5af6-4aed-845b-e6bce95320bc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:35.806709 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-29a22a92-5af6-4aed-845b-e6bce95320bc tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Aug 09 19:20:35.807270 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 412/815] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:20:35 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:36.375374 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:36.376012 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:36.383642 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:36.384170 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:36.384638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:36.385345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:36.385799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:36.386221 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:36.527450 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:36.535536 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e8546717-4374-45a6-a5c3-73584a1ebe94 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1558 microversion: 2.1 time: 0.164247 Aug 09 19:20:36.536108 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 404/816] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:36 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:36.557420 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2f41ad9c-b7a4-4224-b9b0-5c420a994d53 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:36.558036 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2f41ad9c-b7a4-4224-b9b0-5c420a994d53 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:36.564578 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f41ad9c-b7a4-4224-b9b0-5c420a994d53 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:36.565297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f41ad9c-b7a4-4224-b9b0-5c420a994d53 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:36.565776 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f41ad9c-b7a4-4224-b9b0-5c420a994d53 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:36.566498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f41ad9c-b7a4-4224-b9b0-5c420a994d53 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:36.566947 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f41ad9c-b7a4-4224-b9b0-5c420a994d53 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:36.567368 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2f41ad9c-b7a4-4224-b9b0-5c420a994d53 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:36.645896 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2f41ad9c-b7a4-4224-b9b0-5c420a994d53 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093362 Aug 09 19:20:36.646537 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 413/817] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Aug 9 19:20:36 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:36.820019 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-def82e20-3178-4ebf-b699-925b47a18ccd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:36.822399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-def82e20-3178-4ebf-b699-925b47a18ccd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:36.828876 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-def82e20-3178-4ebf-b699-925b47a18ccd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:36.829366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-def82e20-3178-4ebf-b699-925b47a18ccd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:36.829802 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-def82e20-3178-4ebf-b699-925b47a18ccd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:36.830499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-def82e20-3178-4ebf-b699-925b47a18ccd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:36.830950 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-def82e20-3178-4ebf-b699-925b47a18ccd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:36.831520 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-def82e20-3178-4ebf-b699-925b47a18ccd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:36.861617 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-def82e20-3178-4ebf-b699-925b47a18ccd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046395 Aug 09 19:20:36.862189 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 405/818] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:20:36 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:37.558458 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1ec5d41b-db12-44a2-9897-ec8a214b4038 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:37.563260 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1ec5d41b-db12-44a2-9897-ec8a214b4038 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:37.571507 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1ec5d41b-db12-44a2-9897-ec8a214b4038 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:37.572725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1ec5d41b-db12-44a2-9897-ec8a214b4038 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:37.573254 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1ec5d41b-db12-44a2-9897-ec8a214b4038 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:37.574107 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1ec5d41b-db12-44a2-9897-ec8a214b4038 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:37.575095 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1ec5d41b-db12-44a2-9897-ec8a214b4038 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:37.576152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1ec5d41b-db12-44a2-9897-ec8a214b4038 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:37.592520 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-683b799f-2497-45d8-a21a-65c771e24653 req-6c1e41a0-f8fa-475f-833a-4d2830c93ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8480c7c-419e-4968-9b71-1e79ad47a8f1", "tag": "c3241f3a-4a9b-4d8f-8773-219c6d06fbba"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:37.603439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-683b799f-2497-45d8-a21a-65c771e24653 req-6c1e41a0-f8fa-475f-833a-4d2830c93ac4 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:37.604282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-683b799f-2497-45d8-a21a-65c771e24653 req-6c1e41a0-f8fa-475f-833a-4d2830c93ac4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:37.604988 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-683b799f-2497-45d8-a21a-65c771e24653 req-6c1e41a0-f8fa-475f-833a-4d2830c93ac4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:37.611433 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1ec5d41b-db12-44a2-9897-ec8a214b4038 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057385 Aug 09 19:20:37.612017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 414/819] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:20:37 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:37.618290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-683b799f-2497-45d8-a21a-65c771e24653 req-6c1e41a0-f8fa-475f-833a-4d2830c93ac4 service nova] Creating event network-changed:c3241f3a-4a9b-4d8f-8773-219c6d06fbba for instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 on hv-cinder-85265 Aug 09 19:20:37.632376 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-683b799f-2497-45d8-a21a-65c771e24653 req-6c1e41a0-f8fa-475f-833a-4d2830c93ac4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042655 Aug 09 19:20:37.633279 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 406/820] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:20:37.762377 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2b77b195-ea46-4e38-9956-0eec1383b08a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:37.762866 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2b77b195-ea46-4e38-9956-0eec1383b08a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:37.768855 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b77b195-ea46-4e38-9956-0eec1383b08a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:37.770769 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b77b195-ea46-4e38-9956-0eec1383b08a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:37.771221 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b77b195-ea46-4e38-9956-0eec1383b08a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:37.772124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b77b195-ea46-4e38-9956-0eec1383b08a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:37.773380 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b77b195-ea46-4e38-9956-0eec1383b08a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:37.774754 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b77b195-ea46-4e38-9956-0eec1383b08a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:37.810104 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2b77b195-ea46-4e38-9956-0eec1383b08a tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/92e14505-0cdd-40e8-b595-668970c1219f" status: 200 len: 194 microversion: 2.1 time: 0.051665 Aug 09 19:20:37.816352 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 415/821] 10.222.0.70 () {58 vars in 1413 bytes} [Tue Aug 9 19:20:37 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/92e14505-0cdd-40e8-b595-668970c1219f => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:37.822153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:37.823453 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:37.831436 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:37.832184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:37.832875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:37.833911 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:37.835054 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:37.835887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:37.885292 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3fcfe072-335c-47e7-b3e0-2f37040f4eca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:37.887690 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3fcfe072-335c-47e7-b3e0-2f37040f4eca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:37.895055 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fcfe072-335c-47e7-b3e0-2f37040f4eca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:37.895543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fcfe072-335c-47e7-b3e0-2f37040f4eca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:37.895977 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fcfe072-335c-47e7-b3e0-2f37040f4eca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:37.897445 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fcfe072-335c-47e7-b3e0-2f37040f4eca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:37.897905 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fcfe072-335c-47e7-b3e0-2f37040f4eca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:37.898534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3fcfe072-335c-47e7-b3e0-2f37040f4eca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:37.929803 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3fcfe072-335c-47e7-b3e0-2f37040f4eca tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056417 Aug 09 19:20:37.934648 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 416/822] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:20:37 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:20:37.946298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lazy-loading 'services' on Instance uuid e85f13dd-9356-4c14-ae58-dbccafee0a9a {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:20:38.042166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ea241410-aea9-4f73-b760-f7047917e40e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/92e14505-0cdd-40e8-b595-668970c1219f" status: 202 len: 0 microversion: 2.1 time: 0.224491 Aug 09 19:20:38.043823 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 407/823] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:20:37 2022] DELETE /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/92e14505-0cdd-40e8-b595-668970c1219f => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:20:38.943444 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e1a13632-7f18-4734-ae1b-0ab2cf507200 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:38.945995 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e1a13632-7f18-4734-ae1b-0ab2cf507200 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:38.952750 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a13632-7f18-4734-ae1b-0ab2cf507200 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:38.953229 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a13632-7f18-4734-ae1b-0ab2cf507200 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:38.953659 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a13632-7f18-4734-ae1b-0ab2cf507200 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:38.954345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a13632-7f18-4734-ae1b-0ab2cf507200 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:38.954788 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a13632-7f18-4734-ae1b-0ab2cf507200 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:38.955214 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e1a13632-7f18-4734-ae1b-0ab2cf507200 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:38.984558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e1a13632-7f18-4734-ae1b-0ab2cf507200 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045241 Aug 09 19:20:38.985045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 417/824] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:20:38 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:20:38.997713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:38.998308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:39.004729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:39.005214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:39.005654 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:39.006602 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:39.007058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:39.007485 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:39.087848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] HTTP exception thrown: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 is not attached to volume 4929b3b6-f59f-47a0-a533-1b7b43f0b78f Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Request method failure captured: Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments/4929b3b6-f59f-47a0-a533-1b7b43f0b78f HTTP/1.1 Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rL6hK2e9eGh--fZq3GQlRTtJF_juDIWF0zd340DAtjvMZpZ3lIRjttqBWh9kFDgOpcBv-XxpacHvIbF36grXbLuVXlzzHXvpvae7zhz7uk2ajNu5JkE3OFh_HJMyKYt1lW13cEDU8SGKVy17wUAdLo83wBwYfwztCz3F6kavNw_j-k Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 63c5b147e9d0494381a36bd407f110db Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-TestMinimumBasicScenario-166581679 Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:20:39.090286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/63c5b147e9d0494381a36bd407f110db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/63c5b147e9d0494381a36bd407f110db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/63c5b147e9d0494381a36bd407f110db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_63c5b147e9d0494381a36bd407f110db"}]}] Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-TestMinimumBasicScenario-166581679 Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 63c5b147e9d0494381a36bd407f110db Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-TestMinimumBasicScenario-166581679 Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-TestMinimumBasicScenario-166581679-project Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: cbec728603924ccabfffc6cc8d18c5c9 Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-TestMinimumBasicScenario-166581679-project Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:20:39.091803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 is not attached to volume 4929b3b6-f59f-47a0-a533-1b7b43f0b78f Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'server_id': '4a38bc60-9e78-4799-a3dc-b5d706eb4aa8', 'id': '4929b3b6-f59f-47a0-a533-1b7b43f0b78f'} Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4929b3b6-f59f-47a0-a533-1b7b43f0b78f. Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:39.092596 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 is not attached to volume 4929b3b6-f59f-47a0-a533-1b7b43f0b78f Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 is not attached to volume 4929b3b6-f59f-47a0-a533-1b7b43f0b78f Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:39.094061 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Returning 404 to user: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 is not attached to volume 4929b3b6-f59f-47a0-a533-1b7b43f0b78f {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:39.095212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5bbc6cbb-6ef8-4522-9b6e-a7ada544b45f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments/4929b3b6-f59f-47a0-a533-1b7b43f0b78f" status: 404 len: 154 microversion: 2.1 time: 0.099838 Aug 09 19:20:39.095212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 408/825] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:20:38 2022] DELETE /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8/os-volume_attachments/4929b3b6-f59f-47a0-a533-1b7b43f0b78f => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 19:20:40.231269 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:40.231774 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:40.238248 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:40.238730 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:40.239160 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:40.239843 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:40.241243 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:40.241732 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:40.268093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:20:40.305665 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-23d3d8cc-43a8-499e-81a0-40d10089450e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:40.306255 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-23d3d8cc-43a8-499e-81a0-40d10089450e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:40.313820 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23d3d8cc-43a8-499e-81a0-40d10089450e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:40.314616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23d3d8cc-43a8-499e-81a0-40d10089450e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:40.315214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23d3d8cc-43a8-499e-81a0-40d10089450e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:40.316407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23d3d8cc-43a8-499e-81a0-40d10089450e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:40.317123 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23d3d8cc-43a8-499e-81a0-40d10089450e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:40.317638 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-23d3d8cc-43a8-499e-81a0-40d10089450e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:40.353179 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2411abef-839c-496b-9fc9-f2d0dada08a0 tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 204 len: 0 microversion: 2.1 time: 0.125309 Aug 09 19:20:40.354343 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 418/826] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:20:40 2022] DELETE /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:20:40.354465 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-23d3d8cc-43a8-499e-81a0-40d10089450e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/b7d03e13-2142-4802-8511-62802a73d248" status: 200 len: 194 microversion: 2.1 time: 0.053508 Aug 09 19:20:40.355056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 409/827] 10.222.0.70 () {58 vars in 1413 bytes} [Tue Aug 9 19:20:40 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/b7d03e13-2142-4802-8511-62802a73d248 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:40.364741 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:40.365749 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:40.366060 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:40.366257 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:40.372306 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:40.372484 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:40.372822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:40.372957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:40.373251 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:40.373371 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:40.373934 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:40.374044 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:40.374382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:40.374512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:40.374796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:40.374895 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:40.458623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lazy-loading 'services' on Instance uuid e85f13dd-9356-4c14-ae58-dbccafee0a9a {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:20:40.516981 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:40.524912 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a5593891-84d6-4f76-944f-d62836bc8dfe tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1554 microversion: 2.1 time: 0.166112 Aug 09 19:20:40.525491 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 419/828] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:40 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:40.534923 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-eda3f0a4-b1b9-4c43-b6cb-108eb5bfc1dc tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/b7d03e13-2142-4802-8511-62802a73d248" status: 202 len: 0 microversion: 2.1 time: 0.173250 Aug 09 19:20:40.535507 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 410/829] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:20:40 2022] DELETE /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments/b7d03e13-2142-4802-8511-62802a73d248 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 19:20:41.546829 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:41.547428 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:41.553880 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:41.554348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:41.554771 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:41.555451 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:41.555897 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:41.556310 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:41.689397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:41.696977 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-93606722-433a-4605-a8a4-c9339b307e7f tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1554 microversion: 2.1 time: 0.154320 Aug 09 19:20:41.697543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 420/830] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:41 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:42.717798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:42.720019 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:42.731162 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:42.731743 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:42.734081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:42.734081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:42.734081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:42.734081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:42.953329 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbec728603924ccabfffc6cc8d18c5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63c5b147e9d0494381a36bd407f110db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:42.961604 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-85e8071b-9069-4b1d-9ee9-bb61977f182c tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 200 len: 1554 microversion: 2.1 time: 0.248145 Aug 09 19:20:42.962373 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 411/831] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:42 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:43.186619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-0d07c938-7002-45f9-926f-5c9f88a59679 req-596b5ee5-5d46-4da8-b671-593fdae2e1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a38bc60-9e78-4799-a3dc-b5d706eb4aa8", "name": "network-vif-deleted", "tag": "7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:43.197834 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-0d07c938-7002-45f9-926f-5c9f88a59679 req-596b5ee5-5d46-4da8-b671-593fdae2e1d5 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:43.198237 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-0d07c938-7002-45f9-926f-5c9f88a59679 req-596b5ee5-5d46-4da8-b671-593fdae2e1d5 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:43.198660 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-0d07c938-7002-45f9-926f-5c9f88a59679 req-596b5ee5-5d46-4da8-b671-593fdae2e1d5 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:43.211840 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-0d07c938-7002-45f9-926f-5c9f88a59679 req-596b5ee5-5d46-4da8-b671-593fdae2e1d5 service nova] Creating event network-vif-deleted:7d9f71da-3cc1-4ff6-8aa2-13a06c97e6df for instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 on hv-cinder-85265 Aug 09 19:20:43.217561 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-0d07c938-7002-45f9-926f-5c9f88a59679 req-596b5ee5-5d46-4da8-b671-593fdae2e1d5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Aug 09 19:20:43.219070 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 421/832] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:43.836073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-43bce8ca-a93e-4ac2-a5e4-5c9ef83b6acb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:43.838315 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-43bce8ca-a93e-4ac2-a5e4-5c9ef83b6acb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:43.845049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-43bce8ca-a93e-4ac2-a5e4-5c9ef83b6acb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:43.845547 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-43bce8ca-a93e-4ac2-a5e4-5c9ef83b6acb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:43.845988 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-43bce8ca-a93e-4ac2-a5e4-5c9ef83b6acb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:43.846714 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-43bce8ca-a93e-4ac2-a5e4-5c9ef83b6acb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:43.847166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-43bce8ca-a93e-4ac2-a5e4-5c9ef83b6acb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:43.847592 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-43bce8ca-a93e-4ac2-a5e4-5c9ef83b6acb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:43.878598 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-43bce8ca-a93e-4ac2-a5e4-5c9ef83b6acb tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046993 Aug 09 19:20:43.879156 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 412/833] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:20:43 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:20:43.982465 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:43.983159 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] [instance: 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:43.989340 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:43.989816 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:43.990844 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:43.991406 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fc5e2dd2-4928-46cb-bdf6-025b8a779043 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:43.991524 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:43.991948 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:43.992360 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:43.993630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fc5e2dd2-4928-46cb-bdf6-025b8a779043 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:43.999726 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc5e2dd2-4928-46cb-bdf6-025b8a779043 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:44.000210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc5e2dd2-4928-46cb-bdf6-025b8a779043 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:44.000689 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc5e2dd2-4928-46cb-bdf6-025b8a779043 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:44.001381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc5e2dd2-4928-46cb-bdf6-025b8a779043 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:44.001831 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc5e2dd2-4928-46cb-bdf6-025b8a779043 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:44.002255 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fc5e2dd2-4928-46cb-bdf6-025b8a779043 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:44.005640 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] HTTP exception thrown: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 could not be found. Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Request method failure captured: Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 HTTP/1.1 Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rL6hK2e9eGh--fZq3GQlRTtJF_juDIWF0zd340DAtjvMZpZ3lIRjttqBWh9kFDgOpcBv-XxpacHvIbF36grXbLuVXlzzHXvpvae7zhz7uk2ajNu5JkE3OFh_HJMyKYt1lW13cEDU8SGKVy17wUAdLo83wBwYfwztCz3F6kavNw_j-k Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 63c5b147e9d0494381a36bd407f110db Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-TestMinimumBasicScenario-166581679 Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:20:44.007282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/63c5b147e9d0494381a36bd407f110db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/63c5b147e9d0494381a36bd407f110db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/63c5b147e9d0494381a36bd407f110db"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_63c5b147e9d0494381a36bd407f110db"}]}] Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-TestMinimumBasicScenario-166581679 Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 63c5b147e9d0494381a36bd407f110db Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-TestMinimumBasicScenario-166581679 Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-TestMinimumBasicScenario-166581679-project Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: cbec728603924ccabfffc6cc8d18c5c9 Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-TestMinimumBasicScenario-166581679-project Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 could not be found. Aug 09 19:20:44.008856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': '4a38bc60-9e78-4799-a3dc-b5d706eb4aa8'} Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 could not be found. Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:44.009721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 could not be found. Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 could not be found. Aug 09 19:20:44.011166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:44.012510 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Returning 404 to user: Instance 4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:44.012510 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4fb94a0f-d9d2-4b9d-b3c9-4d54bcf3bcaa tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8" status: 404 len: 111 microversion: 2.1 time: 0.030419 Aug 09 19:20:44.012869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 422/834] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:43 2022] GET /compute/v2.1/servers/4a38bc60-9e78-4799-a3dc-b5d706eb4aa8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:20:44.017350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d59098d1-8160-4109-ad82-aea04e6810fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] Calling method '.version_select at 0x7fa503679430>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:44.028572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:44.033115 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fc5e2dd2-4928-46cb-bdf6-025b8a779043 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046470 Aug 09 19:20:44.033691 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 413/835] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:20:43 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 19:20:44.036131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d59098d1-8160-4109-ad82-aea04e6810fd tempest-TestMinimumBasicScenario-166581679 tempest-TestMinimumBasicScenario-166581679-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-935185389" status: 202 len: 0 microversion: 2.1 time: 0.022282 Aug 09 19:20:44.036750 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 423/836] 10.222.0.70 () {58 vars in 1269 bytes} [Tue Aug 9 19:20:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-935185389 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:20:44.110903 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:44.111901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:44.119355 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:44.119842 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:44.120276 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:44.121027 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:44.121517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:44.122045 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:44.149785 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:20:44.232722 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3f31e2e7-6b3a-47dd-9c39-0b882e1e171f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 204 len: 0 microversion: 2.1 time: 0.126034 Aug 09 19:20:44.233632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 414/837] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:20:44 2022] DELETE /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:20:44.243942 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:44.245005 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:44.253534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:44.254018 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:44.254872 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:44.255126 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:44.255574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:44.256821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:44.393284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:44.401399 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-542008e9-5340-49e0-aa7b-cc9fe12a9974 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1674 microversion: 2.1 time: 0.162601 Aug 09 19:20:44.401972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 424/838] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:44 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:45.426059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:45.427228 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:45.435714 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:45.436280 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:45.436839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:45.437646 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:45.438240 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:45.438733 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:45.894998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:45.903228 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d9233f45-df2c-4bc1-b1d3-fa4667c0f7ae tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1674 microversion: 2.1 time: 0.483248 Aug 09 19:20:45.903495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 415/839] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:45 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1674 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:46.924772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:46.928898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:46.935688 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:46.937498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:46.938015 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:46.953082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:46.953758 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:46.954493 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:47.124177 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:47.127207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:20:47.139927 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7466dbfb-472b-4b61-ad06-0be1518049e7 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1674 microversion: 2.1 time: 0.219263 Aug 09 19:20:47.140453 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 425/840] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:46 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1674 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:47.984452 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-48398649-ada9-4255-9a90-51b5c71df571 req-100dc9ec-6463-4da8-baf5-175ebd126e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85f13dd-9356-4c14-ae58-dbccafee0a9a", "name": "network-vif-deleted", "tag": "f36f87a5-4bb1-4c40-b98d-eea17d6228e8"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:48.005986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-48398649-ada9-4255-9a90-51b5c71df571 req-100dc9ec-6463-4da8-baf5-175ebd126e22 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:48.007166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-48398649-ada9-4255-9a90-51b5c71df571 req-100dc9ec-6463-4da8-baf5-175ebd126e22 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:48.007822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-48398649-ada9-4255-9a90-51b5c71df571 req-100dc9ec-6463-4da8-baf5-175ebd126e22 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:48.029698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-48398649-ada9-4255-9a90-51b5c71df571 req-100dc9ec-6463-4da8-baf5-175ebd126e22 service nova] Creating event network-vif-deleted:f36f87a5-4bb1-4c40-b98d-eea17d6228e8 for instance e85f13dd-9356-4c14-ae58-dbccafee0a9a on hv-cinder-85265 Aug 09 19:20:48.035599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-48398649-ada9-4255-9a90-51b5c71df571 req-100dc9ec-6463-4da8-baf5-175ebd126e22 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055057 Aug 09 19:20:48.036903 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 416/841] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:48.163958 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:48.164665 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:48.172650 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:48.173362 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:48.174524 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:48.175238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:48.175856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:48.176508 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:48.213881 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:48.214667 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:48.215272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:48.215676 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lazy-loading 'fault' on Instance uuid e85f13dd-9356-4c14-ae58-dbccafee0a9a {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:20:48.284460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05147fb1762748ee9866ccc5bff4d514', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56cc04948356488f8722a735954fd650', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:48.313067 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a2d90b7b-5250-4c9a-8bc2-d2cd5ced8912 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 200 len: 1328 microversion: 2.1 time: 0.155384 Aug 09 19:20:48.314139 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 426/842] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:48 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 1328 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:48.703648 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2cd63033-2f11-4a67-b9ea-0f71e63e240e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:48.706404 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2cd63033-2f11-4a67-b9ea-0f71e63e240e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:48.714930 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd63033-2f11-4a67-b9ea-0f71e63e240e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:48.715504 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd63033-2f11-4a67-b9ea-0f71e63e240e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:48.716010 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd63033-2f11-4a67-b9ea-0f71e63e240e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:48.717052 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd63033-2f11-4a67-b9ea-0f71e63e240e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:48.717733 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd63033-2f11-4a67-b9ea-0f71e63e240e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:48.718380 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2cd63033-2f11-4a67-b9ea-0f71e63e240e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:48.757142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2cd63033-2f11-4a67-b9ea-0f71e63e240e tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057637 Aug 09 19:20:48.758063 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 417/843] 10.222.0.70 () {60 vars in 1343 bytes} [Tue Aug 9 19:20:48 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:20:48.831997 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:48.833064 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:48.841032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:48.841973 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:48.842982 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:48.844372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:48.845431 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:48.846029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:48.877820 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:20:49.027534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2b1dbbd3-2e48-4083-ba12-d5f317478094 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 204 len: 0 microversion: 2.20 time: 0.196557 Aug 09 19:20:49.029782 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 427/844] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Aug 9 19:20:48 2022] DELETE /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 19:20:49.034196 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:49.034814 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:49.041716 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:49.042208 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:49.042647 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:49.043361 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:49.043817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:49.044247 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:49.213678 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:49.223997 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:49.226069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:49.227776 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fb9d8953-8fb8-419e-b69f-41805f0d6fef tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.197472 Aug 09 19:20:49.229358 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 418/845] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:49 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:49.335709 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:49.336494 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:49.343026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:49.343511 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:49.344232 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:49.345250 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:49.345647 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:49.346078 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:49.361071 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] HTTP exception thrown: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Request method failure captured: Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a HTTP/1.1 Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rJU7K0YksPxS5PePLTLPo3aGZVnPv84sX4rmdKaDE5XOERdmYnVzFuSttjBcGEAOVLCosJSyQ-OgOFPw9IXH9YjeEXRTi73GcgYruZvfSlWCeU5xLIKApzzwyorMIy3Jkeznbat5MSOIr1MavQBjLXCHDefd8flfQn4qBIk4TznfAc Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:20:49.362720 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56cc04948356488f8722a735954fd650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56cc04948356488f8722a735954fd650"}]}] Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 05147fb1762748ee9866ccc5bff4d514 Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:49.364303 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'e85f13dd-9356-4c14-ae58-dbccafee0a9a'} Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:49.365763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:49.367196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:49.368503 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Returning 404 to user: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:49.368503 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-06c736d3-9152-4e52-8fcb-bbb96a5201d8 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 404 len: 111 microversion: 2.1 time: 0.032922 Aug 09 19:20:49.368503 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 428/846] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:49 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:20:49.374081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-89d36203-cf98-4378-8b4b-1074996584f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '.version_select at 0x7fa508117f70>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:49.398138 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-89d36203-cf98-4378-8b4b-1074996584f5 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719012478" status: 202 len: 0 microversion: 2.1 time: 0.027990 Aug 09 19:20:49.398909 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 419/847] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Aug 9 19:20:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719012478 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 19:20:50.251517 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:50.252121 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:50.260013 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:50.260762 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:50.261195 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:50.261886 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:50.262536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:50.263223 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:50.421184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:50.430918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:50.432421 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:50.434080 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e70af558-b8c0-4621-8fa9-de040cb62411 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1724 microversion: 2.20 time: 0.186268 Aug 09 19:20:50.434497 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 429/848] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:50 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:51.461382 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:51.463045 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:51.473975 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:51.475804 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:51.477004 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:51.477808 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:51.478392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:51.478891 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:51.574435 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:51.584697 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:51.586430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:51.590298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d2a457db-1769-4415-aef1-c74e55cefcb3 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1656 microversion: 2.20 time: 0.136100 Aug 09 19:20:51.591856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 420/849] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:51 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1656 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:52.360277 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:52.361809 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:52.374312 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-fa1104ee-b5de-4511-b625-1c832e7a5d94 req-666371fc-0c10-40f2-adc7-0d305b95ed81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2fa3b0c-4952-4132-9fae-7b242fb393f5", "name": "network-vif-deleted", "tag": "422e722d-30ec-4f63-8a1b-d4c21996173d"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:20:52.379725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:52.386008 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:52.390067 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:52.391583 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:52.396607 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:52.397634 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:52.413157 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-fa1104ee-b5de-4511-b625-1c832e7a5d94 req-666371fc-0c10-40f2-adc7-0d305b95ed81 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:52.415500 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-fa1104ee-b5de-4511-b625-1c832e7a5d94 req-666371fc-0c10-40f2-adc7-0d305b95ed81 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:52.418240 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] HTTP exception thrown: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Request method failure captured: Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: DELETE /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a HTTP/1.1 Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rJU7K0YksPxS5PePLTLPo3aGZVnPv84sX4rmdKaDE5XOERdmYnVzFuSttjBcGEAOVLCosJSyQ-OgOFPw9IXH9YjeEXRTi73GcgYruZvfSlWCeU5xLIKApzzwyorMIy3Jkeznbat5MSOIr1MavQBjLXCHDefd8flfQn4qBIk4TznfAc Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:20:52.421000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56cc04948356488f8722a735954fd650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56cc04948356488f8722a735954fd650"}]}] Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 05147fb1762748ee9866ccc5bff4d514 Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.423473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'e85f13dd-9356-4c14-ae58-dbccafee0a9a'} Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:52.425605 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.428400 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.430037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-fa1104ee-b5de-4511-b625-1c832e7a5d94 req-666371fc-0c10-40f2-adc7-0d305b95ed81 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:52.439477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-fa1104ee-b5de-4511-b625-1c832e7a5d94 req-666371fc-0c10-40f2-adc7-0d305b95ed81 service nova] Creating event network-vif-deleted:422e722d-30ec-4f63-8a1b-d4c21996173d for instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 on hv-cinder-85265 Aug 09 19:20:52.446325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Returning 404 to user: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:52.446933 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-fa1104ee-b5de-4511-b625-1c832e7a5d94 req-666371fc-0c10-40f2-adc7-0d305b95ed81 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078879 Aug 09 19:20:52.447693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-79926c96-f871-4485-afbc-3f28f424aeea tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 404 len: 111 microversion: 2.1 time: 0.093305 Aug 09 19:20:52.447858 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 421/850] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:20:52.448258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 430/851] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:20:52 2022] DELETE /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:20:52.459842 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:52.460741 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: e85f13dd-9356-4c14-ae58-dbccafee0a9a] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:52.469276 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:52.469929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:52.470427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:52.471232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:52.471792 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:52.472310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:52.493951 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] HTTP exception thrown: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Request method failure captured: Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a HTTP/1.1 Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rJU7K0YksPxS5PePLTLPo3aGZVnPv84sX4rmdKaDE5XOERdmYnVzFuSttjBcGEAOVLCosJSyQ-OgOFPw9IXH9YjeEXRTi73GcgYruZvfSlWCeU5xLIKApzzwyorMIy3Jkeznbat5MSOIr1MavQBjLXCHDefd8flfQn4qBIk4TznfAc Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:20:52.496878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56cc04948356488f8722a735954fd650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56cc04948356488f8722a735954fd650"}]}] Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 05147fb1762748ee9866ccc5bff4d514 Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.499705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'e85f13dd-9356-4c14-ae58-dbccafee0a9a'} Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:52.501300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. Aug 09 19:20:52.503545 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:52.505754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Returning 404 to user: Instance e85f13dd-9356-4c14-ae58-dbccafee0a9a could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:52.505754 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-cb257bbb-341b-4287-8955-ca1239a9cd65 tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a" status: 404 len: 111 microversion: 2.1 time: 0.044705 Aug 09 19:20:52.512537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 422/852] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:52 2022] GET /compute/v2.1/servers/e85f13dd-9356-4c14-ae58-dbccafee0a9a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:20:52.627651 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:52.628645 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:52.651150 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:52.652133 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:52.652816 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:52.653784 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:52.654455 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:52.655082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:52.735359 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:52.739673 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:52.740850 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:52.741565 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lazy-loading 'fault' on Instance uuid c2fa3b0c-4952-4132-9fae-7b242fb393f5 {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:20:52.846992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:52.861816 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:52.865065 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9ad80a549b14b25ac71cd96832a74e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b32d5c45c614fd08a57af6be1143590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:20:52.866314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b6d5410b-2eda-42e0-8799-d217f62dc245 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 200 len: 1372 microversion: 2.20 time: 0.252294 Aug 09 19:20:52.866886 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 431/853] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:52 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 19:20:53.715181 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:53.715698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:53.721950 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:53.722456 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:53.722877 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:53.723581 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:53.724898 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:53.725741 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:53.739608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] HTTP exception thrown: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Request method failure captured: Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d HTTP/1.1 Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rJU7K0YksPxS5PePLTLPo3aGZVnPv84sX4rmdKaDE5XOERdmYnVzFuSttjBcGEAOVLCosJSyQ-OgOFPw9IXH9YjeEXRTi73GcgYruZvfSlWCeU5xLIKApzzwyorMIy3Jkeznbat5MSOIr1MavQBjLXCHDefd8flfQn4qBIk4TznfAc Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:20:53.742149 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56cc04948356488f8722a735954fd650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56cc04948356488f8722a735954fd650"}]}] Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 05147fb1762748ee9866ccc5bff4d514 Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.743548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'ab83633d-a2ac-4257-b317-ed1894b0fd8d'} Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:53.744302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.745655 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.746872 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Returning 404 to user: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:53.746872 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9e9a4f46-9e0a-4cc4-8d25-8158d272036e tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 404 len: 111 microversion: 2.1 time: 0.032515 Aug 09 19:20:53.746872 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 423/854] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:20:53 2022] DELETE /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:20:53.752588 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:53.753261 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] [instance: ab83633d-a2ac-4257-b317-ed1894b0fd8d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:53.761242 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:53.761793 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:53.762395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:53.763294 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:53.763918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:53.764397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:53.779546 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] HTTP exception thrown: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Request method failure captured: Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d HTTP/1.1 Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rJU7K0YksPxS5PePLTLPo3aGZVnPv84sX4rmdKaDE5XOERdmYnVzFuSttjBcGEAOVLCosJSyQ-OgOFPw9IXH9YjeEXRTi73GcgYruZvfSlWCeU5xLIKApzzwyorMIy3Jkeznbat5MSOIr1MavQBjLXCHDefd8flfQn4qBIk4TznfAc Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:20:53.781392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/56cc04948356488f8722a735954fd650"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/56cc04948356488f8722a735954fd650"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_56cc04948356488f8722a735954fd650"}]}] Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 56cc04948356488f8722a735954fd650 Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeTestJSON-622075741 Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 05147fb1762748ee9866ccc5bff4d514 Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeTestJSON-622075741-project Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.782815 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'ab83633d-a2ac-4257-b317-ed1894b0fd8d'} Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:53.783589 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. Aug 09 19:20:53.784882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.785969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] Returning 404 to user: Instance ab83633d-a2ac-4257-b317-ed1894b0fd8d could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:53.785969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-af745c03-8031-46bc-af33-8f474df31e3f tempest-AttachVolumeTestJSON-622075741 tempest-AttachVolumeTestJSON-622075741-project] 10.222.0.70 "GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d" status: 404 len: 111 microversion: 2.1 time: 0.034389 Aug 09 19:20:53.785969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 432/855] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:20:53 2022] GET /compute/v2.1/servers/ab83633d-a2ac-4257-b317-ed1894b0fd8d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 19:20:53.894710 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:53.895331 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:53.902955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:53.903602 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:53.904078 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:53.904818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:53.905282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:53.905707 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:53.921057 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] HTTP exception thrown: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Request method failure captured: Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 HTTP/1.1 Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH3RAkVgVMSVVaIu7eK7sCdz77IAUIop4EWyIkgtdZcutPLENgtR9N8qzuJacT35DlKDOeLNdE2p0C79ljhXCDltrs4hgCPehYbhNMY6jxTvELATcuolLZWZ9lgco8xoq-Pd8D5n9wXdu7u5sQHBZbbStRZOCmxNfwMh8235aVW1qA Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:20:53.923182 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b32d5c45c614fd08a57af6be1143590"}]}] Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: e9ad80a549b14b25ac71cd96832a74e7 Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:53.925070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'c2fa3b0c-4952-4132-9fae-7b242fb393f5'} Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:53.925994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:53.927900 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:53.932097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Returning 404 to user: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:53.932097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b4aa7018-0139-42bc-9b47-13a81c64d5c0 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 404 len: 111 microversion: 2.20 time: 0.042267 Aug 09 19:20:53.932097 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 424/856] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:53 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:20:53.940849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-eecfb50e-158a-4de5-9466-3d055bc76aad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '.version_select at 0x7fa5036aff70>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:53.963352 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-eecfb50e-158a-4de5-9466-3d055bc76aad tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626533613" status: 204 len: 0 microversion: 2.20 time: 0.026811 Aug 09 19:20:53.964037 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 433/857] 10.222.0.70 () {60 vars in 1262 bytes} [Tue Aug 9 19:20:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626533613 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 19:20:55.910762 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:55.911626 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:55.929634 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:55.931803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:55.932509 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:55.934371 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:55.935100 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:55.937887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:55.978907 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] HTTP exception thrown: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Request method failure captured: Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 HTTP/1.1 Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH3RAkVgVMSVVaIu7eK7sCdz77IAUIop4EWyIkgtdZcutPLENgtR9N8qzuJacT35DlKDOeLNdE2p0C79ljhXCDltrs4hgCPehYbhNMY6jxTvELATcuolLZWZ9lgco8xoq-Pd8D5n9wXdu7u5sQHBZbbStRZOCmxNfwMh8235aVW1qA Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:20:55.981241 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b32d5c45c614fd08a57af6be1143590"}]}] Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: e9ad80a549b14b25ac71cd96832a74e7 Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:55.982979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'c2fa3b0c-4952-4132-9fae-7b242fb393f5'} Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:55.983844 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:55.985916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:55.988273 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Returning 404 to user: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:55.988273 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9c5ad665-0c17-46a9-857d-881c2305aab9 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 404 len: 111 microversion: 2.20 time: 0.076577 Aug 09 19:20:55.988273 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 425/858] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Aug 9 19:20:55 2022] DELETE /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:20:55.994176 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:55.995844 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: c2fa3b0c-4952-4132-9fae-7b242fb393f5] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:56.007826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:56.009098 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:56.009766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:56.010697 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:56.011843 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:56.012858 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:56.032033 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] HTTP exception thrown: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Request method failure captured: Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 HTTP/1.1 Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rH3RAkVgVMSVVaIu7eK7sCdz77IAUIop4EWyIkgtdZcutPLENgtR9N8qzuJacT35DlKDOeLNdE2p0C79ljhXCDltrs4hgCPehYbhNMY6jxTvELATcuolLZWZ9lgco8xoq-Pd8D5n9wXdu7u5sQHBZbbStRZOCmxNfwMh8235aVW1qA Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:20:56.033837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b32d5c45c614fd08a57af6be1143590"}]}] Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: e9ad80a549b14b25ac71cd96832a74e7 Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:56.035241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'c2fa3b0c-4952-4132-9fae-7b242fb393f5'} Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:56.036137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. Aug 09 19:20:56.037972 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:56.041150 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Returning 404 to user: Instance c2fa3b0c-4952-4132-9fae-7b242fb393f5 could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:56.042729 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4adcabc6-8610-4eb7-a4f5-075ab4fdc6a2 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5" status: 404 len: 111 microversion: 2.20 time: 0.054499 Aug 09 19:20:56.045404 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 434/859] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:55 2022] GET /compute/v2.1/servers/c2fa3b0c-4952-4132-9fae-7b242fb393f5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:20:57.243571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:57.244961 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:57.258438 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:57.259288 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:57.259991 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:57.260932 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:57.262331 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:57.262995 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:57.282642 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] HTTP exception thrown: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Request method failure captured: Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c HTTP/1.1 Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rH3RAkVgVMSVVaIu7eK7sCdz77IAUIop4EWyIkgtdZcutPLENgtR9N8qzuJacT35DlKDOeLNdE2p0C79ljhXCDltrs4hgCPehYbhNMY6jxTvELATcuolLZWZ9lgco8xoq-Pd8D5n9wXdu7u5sQHBZbbStRZOCmxNfwMh8235aVW1qA Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:20:57.287978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b32d5c45c614fd08a57af6be1143590"}]}] Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: e9ad80a549b14b25ac71cd96832a74e7 Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.289601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'b5249124-ef8d-4931-8114-ad85549b447c'} Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:57.290434 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.291711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.297838 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Returning 404 to user: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:57.298960 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e6c9a022-7336-43c6-b81b-560708353071 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 404 len: 111 microversion: 2.20 time: 0.060791 Aug 09 19:20:57.300796 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 426/860] 10.222.0.70 () {60 vars in 1280 bytes} [Tue Aug 9 19:20:57 2022] DELETE /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 19:20:57.309772 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:20:57.310383 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] [instance: b5249124-ef8d-4931-8114-ad85549b447c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:20:57.319725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:57.321919 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:57.322595 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:57.324228 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:20:57.324963 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:20:57.325608 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:20:57.355961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] HTTP exception thrown: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Request method failure captured: Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c HTTP/1.1 Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rH3RAkVgVMSVVaIu7eK7sCdz77IAUIop4EWyIkgtdZcutPLENgtR9N8qzuJacT35DlKDOeLNdE2p0C79ljhXCDltrs4hgCPehYbhNMY6jxTvELATcuolLZWZ9lgco8xoq-Pd8D5n9wXdu7u5sQHBZbbStRZOCmxNfwMh8235aVW1qA Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:20:57.361103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8b32d5c45c614fd08a57af6be1143590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8b32d5c45c614fd08a57af6be1143590"}]}] Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 8b32d5c45c614fd08a57af6be1143590 Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-653507305 Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: e9ad80a549b14b25ac71cd96832a74e7 Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeShelveTestJSON-653507305-project Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.362499 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'b5249124-ef8d-4931-8114-ad85549b447c'} Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:20:57.363523 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. Aug 09 19:20:57.365385 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:20:57.374020 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] Returning 404 to user: Instance b5249124-ef8d-4931-8114-ad85549b447c could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:20:57.375648 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8e08c5c0-563d-4e6b-abe8-0d0a09aa3453 tempest-AttachVolumeShelveTestJSON-653507305 tempest-AttachVolumeShelveTestJSON-653507305-project] 10.222.0.70 "GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c" status: 404 len: 111 microversion: 2.20 time: 0.070368 Aug 09 19:20:57.376494 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 435/861] 10.222.0.70 () {60 vars in 1277 bytes} [Tue Aug 9 19:20:57 2022] GET /compute/v2.1/servers/b5249124-ef8d-4931-8114-ad85549b447c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:21:05.116455 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-016b60cb-119f-48c2-b87a-be5688187692 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] Action: 'create', calling method: .version_select at 0x7fa5081170d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-975575816", "metadata": {"Type": "work"}}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:05.659695 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-016b60cb-119f-48c2-b87a-be5688187692 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.877290 Aug 09 19:21:05.660958 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 427/862] 10.222.0.70 () {60 vars in 1156 bytes} [Tue Aug 9 19:21:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 879 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 09 19:21:05.674766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c681938a-6c4c-4967-a13b-8c8c7e1453ee tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] Calling method '.version_select at 0x7fa5037cfca0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:05.767916 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c681938a-6c4c-4967-a13b-8c8c7e1453ee tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf" status: 200 len: 352 microversion: 2.1 time: 0.097626 Aug 09 19:21:05.770307 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 436/863] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:21:05 2022] GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:06.786281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5a7d606b-8ba8-4f5a-9708-32ba7f50ec16 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] Calling method '.version_select at 0x7fa508102ee0>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:06.854090 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5a7d606b-8ba8-4f5a-9708-32ba7f50ec16 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf" status: 200 len: 353 microversion: 2.1 time: 0.074624 Aug 09 19:21:06.855066 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 428/864] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:21:06 2022] GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:06.868149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a4190f45-86a2-47e5-a2e6-c2bbcc2a6799 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] Calling method '.version_select at 0x7fa503720310>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:06.940471 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a4190f45-86a2-47e5-a2e6-c2bbcc2a6799 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf" status: 200 len: 353 microversion: 2.1 time: 0.076750 Aug 09 19:21:06.941649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 437/865] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:21:06 2022] GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf => generated 353 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:06.978268 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4b0defe4-3403-44a6-82f0-4c838c26301d tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] Calling method '.version_select at 0x7fa5035db0d0>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:07.114998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4b0defe4-3403-44a6-82f0-4c838c26301d tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf" status: 202 len: 0 microversion: 2.1 time: 0.154597 Aug 09 19:21:07.119617 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 429/866] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:21:06 2022] DELETE /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:21:07.128254 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-47891b71-8ba6-4362-b17d-9486868c44c5 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] Calling method '.version_select at 0x7fa503647a60>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:07.242415 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-47891b71-8ba6-4362-b17d-9486868c44c5 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf" status: 200 len: 352 microversion: 2.1 time: 0.121797 Aug 09 19:21:07.243335 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 438/867] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:21:07 2022] GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:08.256407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f88c92bd-8d7a-4bb7-9a45-e2bf0abe1c90 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] Calling method '.version_select at 0x7fa5035dbee0>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:08.263732 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:08.264510 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:08.297876 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-f88c92bd-8d7a-4bb7-9a45-e2bf0abe1c90 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] HTTP exception thrown: Volume f3115cd3-c1a1-4179-86a3-80920cb24fcf could not be found. Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f88c92bd-8d7a-4bb7-9a45-e2bf0abe1c90 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] Request method failure captured: Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf HTTP/1.1 Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rOgYB6Lx2pGSqygqrUOpbRlN665mu4BaXFPyNwcLyLQ9uAji7Eio8sN-rCi8bnlW77TAeNM0FKub01SXGTWbKPqQ_FT3KrPEWtxic4nexyOdKosC14xNjw8bMEyQ4S--c0xEHS9KQ3oPEUTRfCLfUqUhUZj_JZUGE-FrB4nI07IhNY Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: bda36c8a4ba04263a908f7d328e81334 Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesGetTestJSON-880789010 Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:21:08.302713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bda36c8a4ba04263a908f7d328e81334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bda36c8a4ba04263a908f7d328e81334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bda36c8a4ba04263a908f7d328e81334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bda36c8a4ba04263a908f7d328e81334"}]}] Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesGetTestJSON-880789010 Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: bda36c8a4ba04263a908f7d328e81334 Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesGetTestJSON-880789010 Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesGetTestJSON-880789010-project Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: e16f8c4c7d9a4b34bdc4cd75a4b8ea22 Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesGetTestJSON-880789010-project Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Volume f3115cd3-c1a1-4179-86a3-80920cb24fcf could not be found. Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'f3115cd3-c1a1-4179-86a3-80920cb24fcf'} Aug 09 19:21:08.304069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f3115cd3-c1a1-4179-86a3-80920cb24fcf could not be found. (HTTP 404) (Request-ID: req-184964d8-6733-4580-9fa4-970b8b1f28b0) Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:21:08.313601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:21:08.315560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f3115cd3-c1a1-4179-86a3-80920cb24fcf could not be found. Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 19:21:08.316874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f3115cd3-c1a1-4179-86a3-80920cb24fcf could not be found. Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f3115cd3-c1a1-4179-86a3-80920cb24fcf could not be found. Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f88c92bd-8d7a-4bb7-9a45-e2bf0abe1c90 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] Returning 404 to user: Volume f3115cd3-c1a1-4179-86a3-80920cb24fcf could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f88c92bd-8d7a-4bb7-9a45-e2bf0abe1c90 tempest-VolumesGetTestJSON-880789010 tempest-VolumesGetTestJSON-880789010-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf" status: 404 len: 109 microversion: 2.1 time: 0.059141 Aug 09 19:21:08.319282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 430/868] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:21:08 2022] GET /compute/v2.1/os-volumes/f3115cd3-c1a1-4179-86a3-80920cb24fcf => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:21:08.519793 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:08.521508 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:08.756534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-061a580b-9746-4300-b1bc-feb06b3704a4 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Action: 'create', calling method: .version_select at 0x7fa503647a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1809775392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkSIML+q2O4Yip+fZlf0dUzK9uWnMMwIerSOs77EXebrBVNZjMVrM32akk0nM6HFXVGnafqvRtPwzDSb6n4v3cWKBIildHS/snzbiY/YR1M2zhCDBfHryyby497TOXaMg=="}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:08.774462 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-061a580b-9746-4300-b1bc-feb06b3704a4 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Getting quotas for project 57933942d654420985e7bc588dc98c1f. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:21:08.779316 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-061a580b-9746-4300-b1bc-feb06b3704a4 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Getting quotas for user b66be721908a4eb1a136d416a4d8b2f9 and project 57933942d654420985e7bc588dc98c1f. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:21:08.810785 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-061a580b-9746-4300-b1bc-feb06b3704a4 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.291286 Aug 09 19:21:08.811503 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 439/869] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:21:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:21:21.380630 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-aaa9548c-cb3f-4216-afdb-e43cb9daa2ab tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:21.381304 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-aaa9548c-cb3f-4216-afdb-e43cb9daa2ab tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:21.388272 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aaa9548c-cb3f-4216-afdb-e43cb9daa2ab tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:21.388879 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aaa9548c-cb3f-4216-afdb-e43cb9daa2ab tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:21.389410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aaa9548c-cb3f-4216-afdb-e43cb9daa2ab tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:21.390072 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aaa9548c-cb3f-4216-afdb-e43cb9daa2ab tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:21.390528 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aaa9548c-cb3f-4216-afdb-e43cb9daa2ab tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:21.391396 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-aaa9548c-cb3f-4216-afdb-e43cb9daa2ab tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:21.422495 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-aaa9548c-cb3f-4216-afdb-e43cb9daa2ab tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1/ips" status: 200 len: 150 microversion: 2.1 time: 0.047225 Aug 09 19:21:21.423266 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 431/870] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:21:21 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:21.437178 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17c62481-bf0b-4d7a-a1c3-af6f36894ee2"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:21.440055 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:21.444425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=4 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:21.445262 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:21.449460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:21.449961 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:21.450592 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:21.451271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:21.451717 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:21.452305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:21.556636 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Invalid volume: volume 17c62481-bf0b-4d7a-a1c3-af6f36894ee2 is already attached to instances: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: POST /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1/os-volume_attachments HTTP/1.1 Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 74 Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:21:21.558259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {"volumeAttachment": {"volumeId": "17c62481-bf0b-4d7a-a1c3-af6f36894ee2"}} Aug 09 19:21:21.559725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Invalid volume: volume 17c62481-bf0b-4d7a-a1c3-af6f36894ee2 is already attached to instances: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'server_id': 'a8480c7c-419e-4968-9b71-1e79ad47a8f1', 'body': {'volumeAttachment': {'volumeId': '17c62481-bf0b-4d7a-a1c3-af6f36894ee2'}}} Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17c62481-bf0b-4d7a-a1c3-af6f36894ee2 is already attached to instances: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:21:21.560558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17c62481-bf0b-4d7a-a1c3-af6f36894ee2 is already attached to instances: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:21.561920 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:21:21.563183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:21:21.563183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:21:21.563183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:21:21.563183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17c62481-bf0b-4d7a-a1c3-af6f36894ee2 is already attached to instances: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c Aug 09 19:21:21.563183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:21:21.563183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 400 to user: Invalid volume: volume 17c62481-bf0b-4d7a-a1c3-af6f36894ee2 is already attached to instances: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:21:21.563183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-22ac6dec-ec11-4dc1-8bf6-0bdd70ffd846 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.127757 Aug 09 19:21:21.563183 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 440/871] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:21:21 2022] POST /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1/os-volume_attachments => generated 174 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:21:21.569254 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:21.569859 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:21.575879 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:21.576359 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:21.577445 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:21.578181 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:21.578799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:21.579391 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:21.611807 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:21:21.710068 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-689663f1-bb89-4640-864a-e21501edcb23 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 204 len: 0 microversion: 2.1 time: 0.145003 Aug 09 19:21:21.719206 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:21.719796 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:21.720534 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 432/872] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:21:21 2022] DELETE /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:21:21.726722 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:21.727235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:21.727630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:21.728316 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:21.728782 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:21.729198 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:21.880714 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:21.891628 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4c1ec4b6-7ce2-4029-897d-80ff0a7ae4fe tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1683 microversion: 2.1 time: 0.176219 Aug 09 19:21:21.892372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 441/873] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:21 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:22.914153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:22.914847 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:22.921496 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:22.921973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:22.922403 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:22.923165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:22.924310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:22.924760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:23.066051 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:23.074002 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a44b0ac8-56f2-4173-aac6-086bb414c370 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1683 microversion: 2.1 time: 0.164808 Aug 09 19:21:23.074581 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 433/874] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:22 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:24.095061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:24.095672 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:24.129124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:24.130093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:24.135544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:24.136312 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:24.136943 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:24.137383 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:24.150089 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-d927b610-6569-4149-8917-3584df9511dc req-045bd66b-e23b-4864-8369-d5ba3f0600ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8480c7c-419e-4968-9b71-1e79ad47a8f1", "name": "network-vif-deleted", "tag": "c3241f3a-4a9b-4d8f-8773-219c6d06fbba"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:24.179616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-d927b610-6569-4149-8917-3584df9511dc req-045bd66b-e23b-4864-8369-d5ba3f0600ba service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:24.181895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-d927b610-6569-4149-8917-3584df9511dc req-045bd66b-e23b-4864-8369-d5ba3f0600ba service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:24.184200 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-d927b610-6569-4149-8917-3584df9511dc req-045bd66b-e23b-4864-8369-d5ba3f0600ba service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:24.201172 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-d927b610-6569-4149-8917-3584df9511dc req-045bd66b-e23b-4864-8369-d5ba3f0600ba service nova] Creating event network-vif-deleted:c3241f3a-4a9b-4d8f-8773-219c6d06fbba for instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 on hv-cinder-85265 Aug 09 19:21:24.209546 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-d927b610-6569-4149-8917-3584df9511dc req-045bd66b-e23b-4864-8369-d5ba3f0600ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061172 Aug 09 19:21:24.214027 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 434/875] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:21:24.251902 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:24.261513 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4ce93e7e-e3b7-4101-b17c-0c8531906fce tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1615 microversion: 2.1 time: 0.170173 Aug 09 19:21:24.262775 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 442/876] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:24 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1615 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:25.284941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:25.285640 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:25.292699 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:25.293388 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:25.294073 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:25.295341 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:25.295772 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:25.296068 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:25.369682 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:25.377432 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8ff66d75-3878-44db-b21f-d6fe487044c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1327 microversion: 2.1 time: 0.096584 Aug 09 19:21:25.378008 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 435/877] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:25 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:26.399331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:26.399956 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:26.406455 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:26.406954 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:26.407372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:26.408063 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:26.408547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:26.408971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:26.475806 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:26.484032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ee58c29d-bff5-4414-9244-55e39853c744 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 200 len: 1327 microversion: 2.1 time: 0.089314 Aug 09 19:21:26.484623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 443/878] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:26 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 1327 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:27.505347 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:27.506029 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:27.515404 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:27.516077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:27.516550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:27.517846 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:27.518499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:27.518942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:27.532988 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 HTTP/1.1 Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:21:27.534618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:21:27.536768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'a8480c7c-419e-4968-9b71-1e79ad47a8f1'} Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:21:27.537537 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:21:27.539603 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:27.542060 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:21:27.542060 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-135691c2-4029-499c-996b-f6ffa1f370f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 404 len: 111 microversion: 2.1 time: 0.035506 Aug 09 19:21:27.542060 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 436/879] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:27 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:21:27.546306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4950e503-314f-4550-9436-23e4bd817ad4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '.version_select at 0x7fa5036af310>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:27.569106 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4950e503-314f-4550-9436-23e4bd817ad4 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744353413" status: 202 len: 0 microversion: 2.1 time: 0.026804 Aug 09 19:21:27.569698 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 444/880] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Aug 9 19:21:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744353413 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 19:21:28.360327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:28.360855 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:28.367738 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:28.368222 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:28.368693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:28.369384 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:28.369891 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:28.370311 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:28.457409 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lazy-loading 'services' on Instance uuid 3a42acc3-2c59-41b1-aaf2-323a41f9a49c {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:21:28.531928 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-79edb89c-2e93-44a5-bb57-74e93a591c55 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments/17c62481-bf0b-4d7a-a1c3-af6f36894ee2" status: 202 len: 0 microversion: 2.1 time: 0.175320 Aug 09 19:21:28.532583 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 437/881] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:21:28 2022] DELETE /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments/17c62481-bf0b-4d7a-a1c3-af6f36894ee2 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:21:28.542171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d4772d42-2b98-4bc5-9070-228feeffca7a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:28.544486 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d4772d42-2b98-4bc5-9070-228feeffca7a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:28.553983 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4772d42-2b98-4bc5-9070-228feeffca7a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:28.555034 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4772d42-2b98-4bc5-9070-228feeffca7a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:28.555546 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4772d42-2b98-4bc5-9070-228feeffca7a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:28.556623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4772d42-2b98-4bc5-9070-228feeffca7a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:28.557152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4772d42-2b98-4bc5-9070-228feeffca7a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:28.557649 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d4772d42-2b98-4bc5-9070-228feeffca7a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:28.587561 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d4772d42-2b98-4bc5-9070-228feeffca7a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050094 Aug 09 19:21:28.588137 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 445/882] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:21:28 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:29.600983 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2e2adbae-6ed8-43b4-8349-9e543a067ba8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:29.603236 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2e2adbae-6ed8-43b4-8349-9e543a067ba8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:29.609760 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e2adbae-6ed8-43b4-8349-9e543a067ba8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:29.610239 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e2adbae-6ed8-43b4-8349-9e543a067ba8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:29.610669 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e2adbae-6ed8-43b4-8349-9e543a067ba8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:29.611351 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e2adbae-6ed8-43b4-8349-9e543a067ba8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:29.611801 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e2adbae-6ed8-43b4-8349-9e543a067ba8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:29.612223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e2adbae-6ed8-43b4-8349-9e543a067ba8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:29.642317 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2e2adbae-6ed8-43b4-8349-9e543a067ba8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046747 Aug 09 19:21:29.642872 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 438/883] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:21:29 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:30.654986 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0ff84cc3-f414-482f-ab9d-1c284af71928 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:30.657185 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0ff84cc3-f414-482f-ab9d-1c284af71928 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:30.664715 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0ff84cc3-f414-482f-ab9d-1c284af71928 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:30.665187 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0ff84cc3-f414-482f-ab9d-1c284af71928 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:30.665619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0ff84cc3-f414-482f-ab9d-1c284af71928 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:30.666339 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0ff84cc3-f414-482f-ab9d-1c284af71928 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:30.666787 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0ff84cc3-f414-482f-ab9d-1c284af71928 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:30.667205 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0ff84cc3-f414-482f-ab9d-1c284af71928 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:30.701549 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0ff84cc3-f414-482f-ab9d-1c284af71928 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050251 Aug 09 19:21:30.702191 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 446/884] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:21:30 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:31.718317 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2af80dcd-15cf-4c1a-97df-442f2940bc99 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:31.721455 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2af80dcd-15cf-4c1a-97df-442f2940bc99 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:31.732708 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2af80dcd-15cf-4c1a-97df-442f2940bc99 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:31.733390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2af80dcd-15cf-4c1a-97df-442f2940bc99 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:31.734113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2af80dcd-15cf-4c1a-97df-442f2940bc99 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:31.735049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2af80dcd-15cf-4c1a-97df-442f2940bc99 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:31.735579 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2af80dcd-15cf-4c1a-97df-442f2940bc99 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:31.736211 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2af80dcd-15cf-4c1a-97df-442f2940bc99 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:31.769203 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2af80dcd-15cf-4c1a-97df-442f2940bc99 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057725 Aug 09 19:21:31.769768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 439/885] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:21:31 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:32.023477 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-38433334", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1809775392", "security_groups": [{"name": "tempest-secgroup-smoke-150721088"}], "networks": [{"uuid": "d9ddcad7-2700-4939-b393-98ccf6b5fda9"}], "block_device_mapping_v2": [{"uuid": "a0a9a4c4-b5d1-461b-a9e7-20fca9beceef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:32.138184 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] validate_networks() for [('d9ddcad7-2700-4939-b393-98ccf6b5fda9', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:21:32.558264 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:21:32.558680 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:21:32.559146 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:21:32.559602 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:21:32.560001 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:21:32.569006 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:32.569478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:32.569904 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:32.570621 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:32.571067 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:32.571482 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:32.588488 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Getting quotas for project 57933942d654420985e7bc588dc98c1f. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:21:32.592420 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Getting quotas for user b66be721908a4eb1a136d416a4d8b2f9 and project 57933942d654420985e7bc588dc98c1f. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:21:32.649724 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:21:32.651909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0a9a4c4-b5d1-461b-a9e7-20fca9beceef',volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:21:32.782669 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c15cbea3-1683-45f1-9353-4f4425a75a16 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:32.786601 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c15cbea3-1683-45f1-9353-4f4425a75a16 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:32.793126 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c15cbea3-1683-45f1-9353-4f4425a75a16 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:32.794843 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c15cbea3-1683-45f1-9353-4f4425a75a16 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:32.795366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c15cbea3-1683-45f1-9353-4f4425a75a16 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:32.796134 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c15cbea3-1683-45f1-9353-4f4425a75a16 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:32.796299 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0012c556-ac83-4c89-b258-6bb472d03f06 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.776912 Aug 09 19:21:32.796892 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c15cbea3-1683-45f1-9353-4f4425a75a16 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:32.797032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 447/886] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:21:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:21:32.797431 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c15cbea3-1683-45f1-9353-4f4425a75a16 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:32.809544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d9a24758-c3d5-4375-b876-87c113b0ba3d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:32.810259 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d9a24758-c3d5-4375-b876-87c113b0ba3d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:32.831210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c15cbea3-1683-45f1-9353-4f4425a75a16 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052863 Aug 09 19:21:32.837099 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 440/887] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:21:32 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:21:32.870926 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d9a24758-c3d5-4375-b876-87c113b0ba3d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:32.879421 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d9a24758-c3d5-4375-b876-87c113b0ba3d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1087 microversion: 2.1 time: 0.074246 Aug 09 19:21:32.884540 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 448/888] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:32 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1087 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:32.899403 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:32.900174 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:32.906552 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:32.907102 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:32.907605 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:32.908299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:32.908776 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:32.909635 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:32.937806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:21:33.037075 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e979bd5f-a772-4284-a4ff-be512282ba6b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 204 len: 0 microversion: 2.1 time: 0.140687 Aug 09 19:21:33.037392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 441/889] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:21:32 2022] DELETE /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:21:33.050096 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:33.051056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:33.224833 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:33.225327 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:33.225751 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:33.226446 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:33.226889 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:33.227305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:33.361838 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:33.370950 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-66aabb86-13d3-4fb8-8d21-0f807ff39653 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1681 microversion: 2.1 time: 0.328722 Aug 09 19:21:33.371609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 449/890] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:33 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1681 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:33.905536 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:33.906285 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:33.913292 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:33.913793 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:33.914214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:33.914919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:33.915370 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:33.915804 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:33.983548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:33.991719 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-3e528eb1-f647-4507-a431-c117f76dfa01 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1137 microversion: 2.1 time: 0.090654 Aug 09 19:21:33.992283 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 442/891] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:33 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1137 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:34.392452 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:34.393207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:34.400669 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:34.401232 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:34.402126 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:34.402456 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:34.402945 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:34.403366 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:34.541129 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:34.549520 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b6db113f-7c2b-410f-b6f0-09526dbff158 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1681 microversion: 2.1 time: 0.161024 Aug 09 19:21:34.550087 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 450/892] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:34 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:35.015928 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:35.016833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:35.034700 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:35.035287 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:35.035882 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:35.036752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:35.037378 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:35.038011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:35.156887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:35.168087 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-67dde904-ca18-4518-b56a-79a565c87c8b tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1185 microversion: 2.1 time: 0.156724 Aug 09 19:21:35.181171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 443/893] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:35 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:35.570894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:35.571510 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:35.578045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:35.578532 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:35.578962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:35.579712 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:35.580279 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:35.580924 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:35.715345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:35.724698 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f5bb426f-c7a0-48ca-8096-f23c356a36e3 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1681 microversion: 2.1 time: 0.157577 Aug 09 19:21:35.726575 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 451/894] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:35 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:35.995362 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-a57191db-4139-456f-9fe0-032904b9a9e6 req-bce99d2f-72b6-4457-9af9-960ec5dbc441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a42acc3-2c59-41b1-aaf2-323a41f9a49c", "name": "network-vif-deleted", "tag": "ccf261a8-4dd0-437d-a49c-febccb36b700"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:36.005142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-a57191db-4139-456f-9fe0-032904b9a9e6 req-bce99d2f-72b6-4457-9af9-960ec5dbc441 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:36.005541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-a57191db-4139-456f-9fe0-032904b9a9e6 req-bce99d2f-72b6-4457-9af9-960ec5dbc441 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:36.005976 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-a57191db-4139-456f-9fe0-032904b9a9e6 req-bce99d2f-72b6-4457-9af9-960ec5dbc441 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:36.016951 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-a57191db-4139-456f-9fe0-032904b9a9e6 req-bce99d2f-72b6-4457-9af9-960ec5dbc441 service nova] Creating event network-vif-deleted:ccf261a8-4dd0-437d-a49c-febccb36b700 for instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c on hv-cinder-85265 Aug 09 19:21:36.021823 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-a57191db-4139-456f-9fe0-032904b9a9e6 req-bce99d2f-72b6-4457-9af9-960ec5dbc441 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030171 Aug 09 19:21:36.022414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 444/895] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:36.198141 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:36.198752 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:36.205980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:36.206476 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:36.206914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:36.207679 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:36.208129 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:36.208573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:36.311919 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:36.320845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-603cd52a-c371-4d78-92c1-78279468fd52 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1203 microversion: 2.1 time: 0.126735 Aug 09 19:21:36.333191 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 452/896] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:36 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1203 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:36.748214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:36.748977 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:36.756547 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:36.757301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:36.757749 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:36.758459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:36.758916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:36.759340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:36.842165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:36.846463 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:36.852477 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fdc59a9b-febd-4e19-a995-83f063f31ab0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1614 microversion: 2.1 time: 0.110207 Aug 09 19:21:36.864828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 445/897] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:36 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:37.342917 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:37.343528 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:37.349736 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:37.350212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:37.350643 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:37.351323 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:37.351771 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:37.352193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:37.486130 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:37.493813 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d7a49028-7a8d-4aff-9ace-7e2efd3418b2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1270 microversion: 2.1 time: 0.154884 Aug 09 19:21:37.494374 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 453/898] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:37 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1270 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:37.875410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:37.875951 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:37.883085 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:37.883653 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:37.884093 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:37.884816 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:37.885268 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:37.885692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:37.953122 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:37.962165 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1e40ba95-347b-4410-b1b0-d75233144458 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 200 len: 1614 microversion: 2.1 time: 0.091010 Aug 09 19:21:37.962878 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 446/899] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:37 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:38.514661 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:38.515894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:38.522843 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:38.523591 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:38.524199 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:38.524944 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:38.525401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:38.525829 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:38.594866 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-de7bd816-1846-4843-a7da-afe98556e619 req-42de56a7-50a9-4913-a85c-7f82ea03ba10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c09854-4821-496a-a89a-053de4272467", "tag": "d04d022a-42d1-4154-87e8-1d6b847ea063"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:38.620571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-de7bd816-1846-4843-a7da-afe98556e619 req-42de56a7-50a9-4913-a85c-7f82ea03ba10 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:38.621251 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-de7bd816-1846-4843-a7da-afe98556e619 req-42de56a7-50a9-4913-a85c-7f82ea03ba10 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:38.621848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-de7bd816-1846-4843-a7da-afe98556e619 req-42de56a7-50a9-4913-a85c-7f82ea03ba10 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:38.635062 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-de7bd816-1846-4843-a7da-afe98556e619 req-42de56a7-50a9-4913-a85c-7f82ea03ba10 service nova] Creating event network-changed:d04d022a-42d1-4154-87e8-1d6b847ea063 for instance 64c09854-4821-496a-a89a-053de4272467 on hv-cinder-85265 Aug 09 19:21:38.640282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-de7bd816-1846-4843-a7da-afe98556e619 req-42de56a7-50a9-4913-a85c-7f82ea03ba10 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049351 Aug 09 19:21:38.641380 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 447/900] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:21:38.888140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:38.896407 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f0da4452-ce46-468c-8a49-1d09b04ba49e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1270 microversion: 2.1 time: 0.385341 Aug 09 19:21:38.896967 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 454/901] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:38 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1270 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:38.986373 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:38.987070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:38.994049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:38.994527 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:38.994955 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:38.995641 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:38.996086 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:38.996529 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:39.011328 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c HTTP/1.1 Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:21:39.013154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:21:39.014899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '3a42acc3-2c59-41b1-aaf2-323a41f9a49c'} Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:21:39.016692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:21:39.018310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:21:39.021492 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:21:39.021492 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-84672330-01d1-4808-bc53-f9ba18e967f8 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 404 len: 111 microversion: 2.1 time: 0.032842 Aug 09 19:21:39.021492 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 448/902] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:38 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:21:39.025852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3311dce6-c663-44c0-9663-9442a482e08b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '.version_select at 0x7fa5037a2940>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:39.046200 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3311dce6-c663-44c0-9663-9442a482e08b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975370595" status: 202 len: 0 microversion: 2.1 time: 0.024463 Aug 09 19:21:39.046909 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 455/903] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Aug 9 19:21:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975370595 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:21:39.778933 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-15016646-0096-46d3-9498-aab5a724c764 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: .version_select at 0x7fa5080c4670>, body: {"keypair": {"name": "tempest-keypair-450919147", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD61vp3Gyx9JXnQV9j+qfkC6JroENeK/MlYz/2gVYmp4fEeZJkZUK9ZiqOzK8WwKAClDk2CQyUgMPLSEUJzPraW2k9kHAlOQvNK0lew8sfeiq/2QJ7r/+0CEk4jHSoA7Pw=="}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:39.803357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-15016646-0096-46d3-9498-aab5a724c764 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for project 46afad886ad34608b533f4ee80a18ba5. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:21:39.803357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-15016646-0096-46d3-9498-aab5a724c764 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for user 4f7899ab15b347b7be75e3433f0d5450 and project 46afad886ad34608b533f4ee80a18ba5. Resources: {'key_pairs'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:21:39.826521 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-15016646-0096-46d3-9498-aab5a724c764 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051473 Aug 09 19:21:39.827229 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 449/904] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:21:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:39.919781 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:39.920623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:39.936820 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:39.937713 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:39.939076 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:39.939848 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:39.940752 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:39.941423 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:40.200799 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:40.209496 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4d535dbf-96ac-4247-8ddd-0ace731ca413 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.295173 Aug 09 19:21:40.210512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 456/905] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:39 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:41.232480 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:41.233127 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:41.245768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:41.246637 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:41.247094 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:41.247837 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:41.248502 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:41.249703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:41.251386 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1057725852", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f05d1eed-0f4c-4655-a75a-07649579d361"}], "security_groups": [{"name": "tempest-securitygroup--1854581798"}], "key_name": "tempest-keypair-450919147", "user_data": "}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:41.359449 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] validate_networks() for [('f05d1eed-0f4c-4655-a75a-07649579d361', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:21:41.404777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:41.414637 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c2fbe5ce-ae5b-415e-98cf-9dd8b5848d67 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.186852 Aug 09 19:21:41.415526 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 450/906] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:41 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:41.976871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:21:41.977290 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:21:41.977759 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:21:41.978163 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:21:41.978569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:21:41.987535 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:41.988018 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:41.989004 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:41.989917 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:41.990490 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:41.990962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:42.008502 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for project 46afad886ad34608b533f4ee80a18ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:21:42.012261 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for user 4f7899ab15b347b7be75e3433f0d5450 and project 46afad886ad34608b533f4ee80a18ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:21:42.023460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:21:42.025604 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:21:42.070623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e20cd411-8712-4c2a-bb16-f354bebad89f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.824228 Aug 09 19:21:42.071270 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 457/907] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:21:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 19:21:42.082178 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c9b232a7-0524-464a-97d3-4008eafd0a90 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:42.083394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c9b232a7-0524-464a-97d3-4008eafd0a90 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:42.140349 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c9b232a7-0524-464a-97d3-4008eafd0a90 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:42.147231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c9b232a7-0524-464a-97d3-4008eafd0a90 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1241 microversion: 2.1 time: 0.069072 Aug 09 19:21:42.147817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 451/908] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:42 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:42.442226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:42.444008 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:42.451133 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:42.451585 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:42.452417 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:42.453374 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:42.453845 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:42.454680 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:42.621565 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:42.629645 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ff2dc607-ec70-48b0-a1e7-cd59e25dad7e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.191547 Aug 09 19:21:42.630597 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 458/909] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:42 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:43.186606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:43.190953 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:43.201497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:43.203471 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:43.205637 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:43.207023 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:43.207791 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:43.208467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:43.312167 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:43.324494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-338bbc5d-8695-49b4-9119-0040b728aeea tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1301 microversion: 2.1 time: 0.160424 Aug 09 19:21:43.325355 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 452/910] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:43 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1301 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:43.651121 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:43.652390 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:43.663226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:43.663716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:43.666085 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:43.666859 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:43.667357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:43.667799 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:43.907511 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:43.916722 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-25062bb4-6374-4f42-8fbe-d7cb47b64b62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.269532 Aug 09 19:21:43.919111 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 459/911] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:43 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:44.353740 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:44.355067 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:44.362817 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:44.364036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:44.364693 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:44.365621 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:44.366287 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:44.367141 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:44.566238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:44.575520 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-553d37fb-35f7-4704-aa95-3f6f59c1a9fc tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1367 microversion: 2.1 time: 0.233428 Aug 09 19:21:44.576479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 453/912] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:44 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:44.939193 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:44.939789 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:44.949207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:44.950182 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:44.950858 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:44.951755 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:44.952204 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:44.952824 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:45.021711 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-2293e937-5f45-440e-a095-8084a39442f0 req-895245df-6f51-49b0-bd82-3e68f30e591a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4", "tag": "392babf4-74c7-4258-8824-c122d7bfb3be"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:45.035201 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-2293e937-5f45-440e-a095-8084a39442f0 req-895245df-6f51-49b0-bd82-3e68f30e591a service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:45.036634 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-2293e937-5f45-440e-a095-8084a39442f0 req-895245df-6f51-49b0-bd82-3e68f30e591a service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:45.037085 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-2293e937-5f45-440e-a095-8084a39442f0 req-895245df-6f51-49b0-bd82-3e68f30e591a service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:45.056394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-2293e937-5f45-440e-a095-8084a39442f0 req-895245df-6f51-49b0-bd82-3e68f30e591a service nova] Creating event network-changed:392babf4-74c7-4258-8824-c122d7bfb3be for instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 on hv-cinder-85265 Aug 09 19:21:45.061717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-2293e937-5f45-440e-a095-8084a39442f0 req-895245df-6f51-49b0-bd82-3e68f30e591a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045794 Aug 09 19:21:45.062389 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 454/913] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:21:45.158769 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:45.163041 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:45.168121 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ecbbdee1-8f17-4717-a41a-2e89625159fb tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.232993 Aug 09 19:21:45.168826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 460/914] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:44 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:45.605126 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:45.608105 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:45.622887 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:45.623366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:45.624314 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:45.626604 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:45.627080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:45.627637 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:45.777415 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:45.801390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fe2bc56b-65a3-4483-a428-9541db6065cb tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1367 microversion: 2.1 time: 0.207316 Aug 09 19:21:45.825567 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 455/915] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:45 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:46.191757 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:46.192691 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:46.199490 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:46.199977 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:46.200411 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:46.201158 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:46.201610 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:46.202035 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:46.391521 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:46.401182 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6edad1bb-5dd1-4888-b3ed-5994b6789dff tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.214347 Aug 09 19:21:46.401893 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 461/916] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:46 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:46.822814 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:46.823560 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:46.836764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:46.837409 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:46.837777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:46.838489 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:46.838901 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:46.839322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:46.997454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:47.006050 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4fac987d-3dd1-468a-8e66-daa3eb066ba7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1367 microversion: 2.1 time: 0.187798 Aug 09 19:21:47.006838 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 456/917] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:46 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:47.424711 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:47.425319 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:47.431680 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:47.432154 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:47.432626 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:47.433313 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:47.433762 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:47.434182 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:47.566933 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:47.575470 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b29d20bc-f70d-48aa-a477-68e10e0ea7f2 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.154631 Aug 09 19:21:47.576043 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 462/918] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:47 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:48.036401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:48.039215 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-234242349", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:48.039574 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:48.054535 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:48.055130 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:48.055572 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:48.056276 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:48.056761 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:48.057187 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:48.108313 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] validate_networks() for None {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:21:48.215168 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:48.223729 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-514a5690-fb7e-48f2-aaa9-74acfadff2ca tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1367 microversion: 2.1 time: 0.191175 Aug 09 19:21:48.224749 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 457/919] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:48 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:48.418393 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:21:48.418883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:21:48.419763 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:21:48.420234 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:21:48.420731 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:21:48.431580 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:48.432158 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:48.433308 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:48.434171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:48.435546 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:48.435979 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:48.454288 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Getting quotas for project fb6091337b5842b4bcbad8e1b30f7b57. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:21:48.459263 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Getting quotas for user 8ebd5a14c4d54921ad1b265be545adbd and project fb6091337b5842b4bcbad8e1b30f7b57. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:21:48.473556 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:21:48.475666 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:21:48.505253 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=9 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:48.525258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0879a033-39b7-4186-8937-251913f78b59 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495410 Aug 09 19:21:48.526842 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 463/920] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:21:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:21:48.538774 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-af9d653b-f273-482c-94b9-e7ad90d5eddb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:48.540756 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-af9d653b-f273-482c-94b9-e7ad90d5eddb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:48.599472 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:48.600281 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:48.609444 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:48.610197 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:48.610634 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:48.611332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:48.611810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:48.612236 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:48.615066 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-af9d653b-f273-482c-94b9-e7ad90d5eddb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:48.624580 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-af9d653b-f273-482c-94b9-e7ad90d5eddb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1214 microversion: 2.1 time: 0.089869 Aug 09 19:21:48.625328 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 458/921] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:48 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:48.760883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:48.770079 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6f7ea01b-c958-466f-87aa-ce533a4ef52a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.175986 Aug 09 19:21:48.771446 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 464/922] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:48 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:49.246136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:49.247499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:49.254942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:49.255523 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:49.256030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:49.256920 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:49.257380 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:49.258017 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:49.399407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:49.408210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8895c247-6f14-46f1-ae48-2cd072f34756 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1367 microversion: 2.1 time: 0.166499 Aug 09 19:21:49.408814 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 459/923] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:49 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:49.646402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:49.647166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:49.655113 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:49.655819 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:49.656257 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:49.657020 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:49.657477 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:49.657902 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:49.792858 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:49.793478 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:49.800424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:49.802083 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:49.802552 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:49.803336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:49.803847 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:49.804409 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:49.953532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:49.961981 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-46a73f2c-33dd-4aec-ac69-fd40e670b57d tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.173173 Aug 09 19:21:49.962691 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 460/924] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:49 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:49.978868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:49.986639 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-91e2e30b-8897-45c9-bef5-747a99de0337 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1284 microversion: 2.1 time: 0.344680 Aug 09 19:21:49.987357 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 465/925] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:49 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1284 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:50.344917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-9c3df32b-f977-4011-96b5-5d22d017684f req-5638c163-352b-4a9c-a992-a6d9daf1ac75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c09854-4821-496a-a89a-053de4272467", "name": "network-vif-plugged", "status": "completed", "tag": "d04d022a-42d1-4154-87e8-1d6b847ea063"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:50.359749 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-9c3df32b-f977-4011-96b5-5d22d017684f req-5638c163-352b-4a9c-a992-a6d9daf1ac75 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:50.360543 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-9c3df32b-f977-4011-96b5-5d22d017684f req-5638c163-352b-4a9c-a992-a6d9daf1ac75 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:50.361200 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-9c3df32b-f977-4011-96b5-5d22d017684f req-5638c163-352b-4a9c-a992-a6d9daf1ac75 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:50.376040 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-9c3df32b-f977-4011-96b5-5d22d017684f req-5638c163-352b-4a9c-a992-a6d9daf1ac75 service nova] Creating event network-vif-plugged:d04d022a-42d1-4154-87e8-1d6b847ea063 for instance 64c09854-4821-496a-a89a-053de4272467 on hv-cinder-85265 Aug 09 19:21:50.382376 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-9c3df32b-f977-4011-96b5-5d22d017684f req-5638c163-352b-4a9c-a992-a6d9daf1ac75 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041002 Aug 09 19:21:50.383838 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 461/926] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:50.430110 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:50.431091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:50.445155 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:50.445820 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:50.446388 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:50.447271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:50.449508 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:50.450058 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:50.755674 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:50.764148 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-61300803-a3c2-47a2-893e-82e7dcedae83 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1367 microversion: 2.1 time: 0.338221 Aug 09 19:21:50.764927 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 466/927] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:50 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:50.992004 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:50.992847 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:51.007636 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:51.008568 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:51.015916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:51.017108 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:51.017807 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:51.018874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:51.020144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:51.020741 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:51.021263 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:51.021696 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:51.022238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:51.022409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:51.023055 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:51.024717 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:51.190839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:51.201144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6cb90ba4-ffa5-4d1b-b223-689b18789c89 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.221818 Aug 09 19:21:51.202281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 462/928] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:50 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:51.304912 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:51.312354 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6e4cc2f4-e7fc-487a-ba1a-819b825c5773 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1314 microversion: 2.1 time: 0.308859 Aug 09 19:21:51.312957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 467/929] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:51 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:51.711467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-dc12b0cf-51c8-4d79-9b1c-c1a2c4de661e req-1464fad1-3803-480e-9407-274c1ce16ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccc20d8e-4a35-4ece-ac46-14fab244ca87", "tag": "cfda7d5a-95bf-40c1-a792-b2567ff8d053"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:51.717421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:51.724299 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-dc12b0cf-51c8-4d79-9b1c-c1a2c4de661e req-1464fad1-3803-480e-9407-274c1ce16ecf service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:51.724944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-dc12b0cf-51c8-4d79-9b1c-c1a2c4de661e req-1464fad1-3803-480e-9407-274c1ce16ecf service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:51.725406 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-dc12b0cf-51c8-4d79-9b1c-c1a2c4de661e req-1464fad1-3803-480e-9407-274c1ce16ecf service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:51.744325 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-dc12b0cf-51c8-4d79-9b1c-c1a2c4de661e req-1464fad1-3803-480e-9407-274c1ce16ecf service nova] Creating event network-changed:cfda7d5a-95bf-40c1-a792-b2567ff8d053 for instance ccc20d8e-4a35-4ece-ac46-14fab244ca87 on hv-cinder-85265 Aug 09 19:21:51.749696 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-dc12b0cf-51c8-4d79-9b1c-c1a2c4de661e req-1464fad1-3803-480e-9407-274c1ce16ecf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044059 Aug 09 19:21:51.750292 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 463/930] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:51.786864 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:51.787516 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:51.794112 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:51.794862 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:51.795297 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:51.795995 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:51.796478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:51.796904 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:51.936472 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:51.944554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-520c676a-f19e-4d55-87ca-8da77eec2134 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1367 microversion: 2.1 time: 0.162495 Aug 09 19:21:51.945131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 468/931] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:51 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:52.225046 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:52.225910 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:52.232599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:52.233313 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:52.233788 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:52.234478 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:52.234935 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:52.235356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:52.335051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:52.335669 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:52.341978 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:52.342695 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:52.343333 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:52.344497 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:52.345109 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:52.345681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:52.410654 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:52.419911 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-99490968-75b5-4391-88e9-2447ceec4f4a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1258 microversion: 2.1 time: 0.199792 Aug 09 19:21:52.420527 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 464/932] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:52 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1258 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:52.425804 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-13a876ef-b2c9-40b8-a0be-25a0e1957dde req-e876069e-a4fc-49c3-bdc6-375d46b0203c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4", "name": "network-vif-plugged", "status": "completed", "tag": "392babf4-74c7-4258-8824-c122d7bfb3be"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:52.437462 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-13a876ef-b2c9-40b8-a0be-25a0e1957dde req-e876069e-a4fc-49c3-bdc6-375d46b0203c service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:52.437978 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-13a876ef-b2c9-40b8-a0be-25a0e1957dde req-e876069e-a4fc-49c3-bdc6-375d46b0203c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:52.438424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-13a876ef-b2c9-40b8-a0be-25a0e1957dde req-e876069e-a4fc-49c3-bdc6-375d46b0203c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:52.450554 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-13a876ef-b2c9-40b8-a0be-25a0e1957dde req-e876069e-a4fc-49c3-bdc6-375d46b0203c service nova] Creating event network-vif-plugged:392babf4-74c7-4258-8824-c122d7bfb3be for instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 on hv-cinder-85265 Aug 09 19:21:52.455665 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-13a876ef-b2c9-40b8-a0be-25a0e1957dde req-e876069e-a4fc-49c3-bdc6-375d46b0203c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033995 Aug 09 19:21:52.456745 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 465/933] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:52.591918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:52.600950 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b925c609-3e2e-48a7-baa6-752e7861e8dc tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1314 microversion: 2.1 time: 0.270561 Aug 09 19:21:52.601539 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 469/934] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:52 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:52.967860 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:52.969310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:52.976117 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:52.976632 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:52.977064 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:52.977748 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:52.978200 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:52.978723 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:53.122802 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:53.131574 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2ed647de-7f84-4664-93b1-dde6751ff9bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1367 microversion: 2.1 time: 0.168007 Aug 09 19:21:53.132150 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 466/935] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:52 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:53.445856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:53.446564 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:53.453416 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:53.453895 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:53.454324 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:53.455015 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:53.455458 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:53.456473 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:53.622747 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:53.623363 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:53.629957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:53.632859 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:53.633769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:53.634292 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:53.635487 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:53.636181 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:53.637190 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:53.638441 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5caefe55-ddd5-4295-a756-999eaef3369a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1442 microversion: 2.1 time: 0.200139 Aug 09 19:21:53.639030 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 470/936] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:53 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1442 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:53.662817 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:53.663428 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:53.670234 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:53.670992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:53.671535 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:53.672825 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:53.672825 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:53.673240 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:53.808985 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:53.818994 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-24bb9473-164c-4b4f-8449-00620360e4e8 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1314 microversion: 2.1 time: 0.200094 Aug 09 19:21:53.819505 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 467/937] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:53 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:53.861349 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:53.872969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-89daa7c5-493a-47a5-b003-554add3e5837 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1442 microversion: 2.1 time: 0.213619 Aug 09 19:21:53.873559 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 471/938] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:53 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1442 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:54.152188 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:54.152973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:54.162639 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:54.163599 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:54.164544 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:54.165874 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:54.166458 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:54.166964 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:54.387188 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:54.406613 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bdb728c9-5fcc-4d8b-9c78-81b240ad6964 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1367 microversion: 2.1 time: 0.258419 Aug 09 19:21:54.407227 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 468/939] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:54 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:54.843557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:54.844172 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:54.852014 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:54.852873 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:54.853710 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:54.854626 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:54.856729 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:54.857395 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:55.097047 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:55.105067 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6ae49f16-6700-45fe-8e8e-05fa7b55c9fb tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1314 microversion: 2.1 time: 0.265344 Aug 09 19:21:55.118122 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 472/940] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:54 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:55.428281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:55.429309 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:55.436420 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:55.436954 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:55.437464 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:55.438236 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:55.438772 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:55.439264 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:55.458574 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=100 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:55.685696 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:55.694550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d44b4ecc-9876-4d55-a2db-74ca1be2ae0a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1558 microversion: 2.1 time: 0.270169 Aug 09 19:21:55.695049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 469/941] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:55 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1558 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:55.715061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7df4362d-5c71-470c-8933-1a0afceec96c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:55.715557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7df4362d-5c71-470c-8933-1a0afceec96c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:55.721837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7df4362d-5c71-470c-8933-1a0afceec96c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:55.722996 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7df4362d-5c71-470c-8933-1a0afceec96c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:55.723440 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7df4362d-5c71-470c-8933-1a0afceec96c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:55.724321 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7df4362d-5c71-470c-8933-1a0afceec96c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:55.724801 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7df4362d-5c71-470c-8933-1a0afceec96c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:55.725221 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7df4362d-5c71-470c-8933-1a0afceec96c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:55.808030 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7df4362d-5c71-470c-8933-1a0afceec96c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096843 Aug 09 19:21:55.808644 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 473/942] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Aug 9 19:21:55 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:56.097794 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-7ae87db3-b3a3-4dc2-bdf7-8b6d901b65c1 req-f50bba49-0586-4aab-b85f-178c3504b453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c09854-4821-496a-a89a-053de4272467", "tag": "d04d022a-42d1-4154-87e8-1d6b847ea063"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:56.112178 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7ae87db3-b3a3-4dc2-bdf7-8b6d901b65c1 req-f50bba49-0586-4aab-b85f-178c3504b453 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:56.112841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7ae87db3-b3a3-4dc2-bdf7-8b6d901b65c1 req-f50bba49-0586-4aab-b85f-178c3504b453 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:56.113374 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7ae87db3-b3a3-4dc2-bdf7-8b6d901b65c1 req-f50bba49-0586-4aab-b85f-178c3504b453 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:56.129091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:56.130779 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:56.132338 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-7ae87db3-b3a3-4dc2-bdf7-8b6d901b65c1 req-f50bba49-0586-4aab-b85f-178c3504b453 service nova] Creating event network-changed:d04d022a-42d1-4154-87e8-1d6b847ea063 for instance 64c09854-4821-496a-a89a-053de4272467 on hv-cinder-85265 Aug 09 19:21:56.138536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:56.138944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-7ae87db3-b3a3-4dc2-bdf7-8b6d901b65c1 req-f50bba49-0586-4aab-b85f-178c3504b453 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047031 Aug 09 19:21:56.139615 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:56.140046 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 470/943] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:56.140455 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:56.141508 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:56.142144 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:56.142573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:56.379975 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:56.397716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-08690f44-86d8-4e47-9669-114ab9b22a23 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1314 microversion: 2.1 time: 0.274657 Aug 09 19:21:56.399058 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 474/944] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:56 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:21:57.419600 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:57.420504 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:57.429969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:57.430490 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:57.430921 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:57.432076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:57.432076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:57.432499 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:57.587228 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:57.595414 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-cb3ef12b-5d58-4b8a-89f0-7f0f816d1be1 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1314 microversion: 2.1 time: 0.180283 Aug 09 19:21:57.600117 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 471/945] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:57 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:58.161942 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-dc909acd-83d8-459c-8b4e-a61a2ee2d5bb req-cd44bfd9-8867-40e4-8a5c-a33d27d96c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4", "tag": "392babf4-74c7-4258-8824-c122d7bfb3be"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:58.172498 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-dc909acd-83d8-459c-8b4e-a61a2ee2d5bb req-cd44bfd9-8867-40e4-8a5c-a33d27d96c03 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:58.172984 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-dc909acd-83d8-459c-8b4e-a61a2ee2d5bb req-cd44bfd9-8867-40e4-8a5c-a33d27d96c03 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:58.173969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-dc909acd-83d8-459c-8b4e-a61a2ee2d5bb req-cd44bfd9-8867-40e4-8a5c-a33d27d96c03 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:58.186641 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-dc909acd-83d8-459c-8b4e-a61a2ee2d5bb req-cd44bfd9-8867-40e4-8a5c-a33d27d96c03 service nova] Creating event network-changed:392babf4-74c7-4258-8824-c122d7bfb3be for instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 on hv-cinder-85265 Aug 09 19:21:58.192662 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-dc909acd-83d8-459c-8b4e-a61a2ee2d5bb req-cd44bfd9-8867-40e4-8a5c-a33d27d96c03 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036966 Aug 09 19:21:58.193964 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 475/946] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:58.246430 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-7386053a-2c59-4164-8c25-c22bd374bd1f req-63a1aa7c-85e3-4d51-a144-88b16322d0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc20d8e-4a35-4ece-ac46-14fab244ca87", "name": "network-vif-plugged", "status": "completed", "tag": "cfda7d5a-95bf-40c1-a792-b2567ff8d053"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:21:58.261232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7386053a-2c59-4164-8c25-c22bd374bd1f req-63a1aa7c-85e3-4d51-a144-88b16322d0c5 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:58.262122 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7386053a-2c59-4164-8c25-c22bd374bd1f req-63a1aa7c-85e3-4d51-a144-88b16322d0c5 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:58.262847 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-7386053a-2c59-4164-8c25-c22bd374bd1f req-63a1aa7c-85e3-4d51-a144-88b16322d0c5 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:58.277828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-7386053a-2c59-4164-8c25-c22bd374bd1f req-63a1aa7c-85e3-4d51-a144-88b16322d0c5 service nova] Creating event network-vif-plugged:cfda7d5a-95bf-40c1-a792-b2567ff8d053 for instance ccc20d8e-4a35-4ece-ac46-14fab244ca87 on hv-cinder-85265 Aug 09 19:21:58.284019 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-7386053a-2c59-4164-8c25-c22bd374bd1f req-63a1aa7c-85e3-4d51-a144-88b16322d0c5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042348 Aug 09 19:21:58.285322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 472/947] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:21:58.617131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:58.617863 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:58.619821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=6 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:58.620505 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=20 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:58.626747 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:58.627231 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:58.627664 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:58.628348 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:58.629583 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:58.630030 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:58.760379 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:58.767966 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4b2759d8-5f11-4c1d-b2c8-cfbb159bc079 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1314 microversion: 2.1 time: 0.155778 Aug 09 19:21:58.768558 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 476/948] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:58 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:21:59.786763 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=8 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:21:59.791200 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:21:59.791891 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:21:59.802007 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:59.802571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:59.803011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:59.803782 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:21:59.804231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:21:59.804684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:21:59.937542 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:21:59.945651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-860dc735-cb65-48f9-ade5-d123e6f5af86 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1314 microversion: 2.1 time: 0.160528 Aug 09 19:21:59.946214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 473/949] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:21:59 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:00.966967 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:00.967640 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:00.974970 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:00.975456 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:00.975899 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:00.976631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:00.977088 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:00.977518 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:01.108765 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:01.116402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-a8848eb8-9095-49a7-a8af-0c68c717e8b3 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1464 microversion: 2.1 time: 0.153267 Aug 09 19:22:01.117002 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 477/950] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:00 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:01.162381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:01.162890 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:01.169764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:01.170245 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:01.170678 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:01.171364 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:01.171841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:01.172251 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:01.197924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:22:01.276509 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0913d9b7-51c1-4484-bdf7-4fbc1e2ed6d2 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 204 len: 0 microversion: 2.1 time: 0.117887 Aug 09 19:22:01.277305 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 474/951] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:22:01 2022] DELETE /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:22:01.285463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:01.286277 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:01.292626 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:01.293107 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:01.293539 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:01.294506 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:01.294956 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:01.295374 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:01.432052 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:01.439914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0344eeef-3ff8-4218-8243-3d6e639a3d31 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1470 microversion: 2.1 time: 0.158389 Aug 09 19:22:01.440497 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 478/952] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:01 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:22:02.467154 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:02.468157 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:02.476343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:02.477253 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:02.477704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:02.478412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:02.478916 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:02.479686 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:02.622166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ebd5a14c4d54921ad1b265be545adbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb6091337b5842b4bcbad8e1b30f7b57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:02.630552 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-cadd35f3-d205-4feb-9c62-c876f53c6e57 tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 200 len: 1470 microversion: 2.1 time: 0.168296 Aug 09 19:22:02.631263 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 475/953] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:02 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:03.123669 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-509a73a5-9fc0-4930-9a85-4a0b21c546e0 req-23c4cd72-7539-403e-a11f-8d28d73868ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccc20d8e-4a35-4ece-ac46-14fab244ca87", "name": "network-vif-deleted", "tag": "cfda7d5a-95bf-40c1-a792-b2567ff8d053"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:03.134899 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-509a73a5-9fc0-4930-9a85-4a0b21c546e0 req-23c4cd72-7539-403e-a11f-8d28d73868ef service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:03.136014 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-509a73a5-9fc0-4930-9a85-4a0b21c546e0 req-23c4cd72-7539-403e-a11f-8d28d73868ef service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:03.136157 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-509a73a5-9fc0-4930-9a85-4a0b21c546e0 req-23c4cd72-7539-403e-a11f-8d28d73868ef service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:03.140685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=100 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:03.150545 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-509a73a5-9fc0-4930-9a85-4a0b21c546e0 req-23c4cd72-7539-403e-a11f-8d28d73868ef service nova] Creating event network-vif-deleted:cfda7d5a-95bf-40c1-a792-b2567ff8d053 for instance ccc20d8e-4a35-4ece-ac46-14fab244ca87 on hv-cinder-85265 Aug 09 19:22:03.156139 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-509a73a5-9fc0-4930-9a85-4a0b21c546e0 req-23c4cd72-7539-403e-a11f-8d28d73868ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036223 Aug 09 19:22:03.160075 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 479/954] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:22:03.652302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:03.653167 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] [instance: ccc20d8e-4a35-4ece-ac46-14fab244ca87] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:03.659472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:03.659956 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:03.660396 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:03.661324 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:03.661830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:03.662200 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:03.675939 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] HTTP exception thrown: Instance ccc20d8e-4a35-4ece-ac46-14fab244ca87 could not be found. Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Request method failure captured: Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 HTTP/1.1 Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rPKBb4XFM2UEv-j5pRVW2U3_lrHBfg2XDmIYrV-yY-3NEVdx8tYXSmP2TVOWvyU_IQcyNzs0pdoDhlrsX-P23QBC28cbpm6vCO2N2wfJKFCIdfhg3glmS2-4Mxo8vwJyS5AlRZ8ueV9e7217Si9DSxi75cNePhg-rACvPIh8LfBdSI Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: fb6091337b5842b4bcbad8e1b30f7b57 Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesNegativeTest-1708108666 Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:22:03.677715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fb6091337b5842b4bcbad8e1b30f7b57"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fb6091337b5842b4bcbad8e1b30f7b57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fb6091337b5842b4bcbad8e1b30f7b57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fb6091337b5842b4bcbad8e1b30f7b57"}]}] Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesNegativeTest-1708108666 Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: fb6091337b5842b4bcbad8e1b30f7b57 Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesNegativeTest-1708108666 Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesNegativeTest-1708108666-project Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 8ebd5a14c4d54921ad1b265be545adbd Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesNegativeTest-1708108666-project Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance ccc20d8e-4a35-4ece-ac46-14fab244ca87 could not be found. Aug 09 19:22:03.679421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'ccc20d8e-4a35-4ece-ac46-14fab244ca87'} Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccc20d8e-4a35-4ece-ac46-14fab244ca87 could not be found. Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:22:03.680548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccc20d8e-4a35-4ece-ac46-14fab244ca87 could not be found. Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccc20d8e-4a35-4ece-ac46-14fab244ca87 could not be found. Aug 09 19:22:03.682155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:03.683520 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] Returning 404 to user: Instance ccc20d8e-4a35-4ece-ac46-14fab244ca87 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:22:03.683520 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6677c15d-6c48-412b-87ac-f0cd0a974b0b tempest-VolumesNegativeTest-1708108666 tempest-VolumesNegativeTest-1708108666-project] 10.222.0.70 "GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87" status: 404 len: 111 microversion: 2.1 time: 0.031048 Aug 09 19:22:03.683520 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 476/955] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:03 2022] GET /compute/v2.1/servers/ccc20d8e-4a35-4ece-ac46-14fab244ca87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:22:23.705194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=32 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:23.709489 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-694977762", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-205325892", "security_groups": [{"name": "tempest-secgroup-smoke-1182586383"}], "block_device_mapping_v2": [{"uuid": "709e98a2-f33e-4dbc-b911-6e94396246db", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b9e53f99-225a-4b2a-8235-02ef2f63b2e3"}]}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:23.827512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.network.neutron [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] validate_networks() for [('b9e53f99-225a-4b2a-8235-02ef2f63b2e3', None, None, None, None, None)] {{(pid=117823) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:22:24.219057 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Flavor limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:22:24.219503 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Image limits 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:22:24.220038 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Flavor pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:22:24.220492 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Image pref 0:0:0 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:22:24.220914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.virt.hardware [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117823) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:22:24.230849 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:24.231323 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:24.231753 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:24.232541 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:24.232995 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:24.233417 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:24.250542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Getting quotas for project faf0c6e98206493ea25654f44c9ae563. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:22:24.254544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Getting quotas for user f12cfb692b4b4947bc67a3199aa33e73 and project faf0c6e98206493ea25654f44c9ae563. Resources: {'ram', 'instances', 'cores'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:22:24.313288 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Going to run 1 instances... {{(pid=117823) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:22:24.315435 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='709e98a2-f33e-4dbc-b911-6e94396246db',volume_size=None,volume_type=None)] {{(pid=117823) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:22:24.448957 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-0bc60343-cbe8-4cc2-a5dc-6635fb379cc7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.745291 Aug 09 19:22:24.449596 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 480/956] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:22:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:22:24.460278 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c9e30c48-7755-4236-baf4-553533438a47 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:24.460946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c9e30c48-7755-4236-baf4-553533438a47 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:24.464492 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:24.465421 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:24.523926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-c9e30c48-7755-4236-baf4-553533438a47 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:24.531703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c9e30c48-7755-4236-baf4-553533438a47 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1093 microversion: 2.1 time: 0.075273 Aug 09 19:22:24.532269 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 477/957] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:24 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:25.553326 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:25.554126 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:25.567163 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:25.567652 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:25.568079 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:25.568804 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:25.569258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:25.569684 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:25.648927 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:25.658522 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-62ac1fc2-bc4c-4ed7-86ca-24d1da12bb5f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1209 microversion: 2.1 time: 0.109218 Aug 09 19:22:25.674182 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 481/958] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:25 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:26.683129 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:26.683752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:26.693803 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:26.694296 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:26.694734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:26.695447 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:26.696491 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:26.697173 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:26.832022 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:26.840364 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-685195b4-c98b-4521-bb9a-3a777a963413 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.162244 Aug 09 19:22:26.841216 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 478/959] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:26 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:27.152271 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-51835d05-109c-49e1-8e3c-7758b9ada1d7 req-529e3731-414b-4373-9236-f90f8b41561c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028f2744-e17b-4d70-9ad5-6e5b665b3442", "tag": "36ca2417-d299-4b53-9b7a-d20e1f7bf431"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:27.165680 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-51835d05-109c-49e1-8e3c-7758b9ada1d7 req-529e3731-414b-4373-9236-f90f8b41561c service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:27.166240 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-51835d05-109c-49e1-8e3c-7758b9ada1d7 req-529e3731-414b-4373-9236-f90f8b41561c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:27.166611 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-51835d05-109c-49e1-8e3c-7758b9ada1d7 req-529e3731-414b-4373-9236-f90f8b41561c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:27.178951 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-51835d05-109c-49e1-8e3c-7758b9ada1d7 req-529e3731-414b-4373-9236-f90f8b41561c service nova] Creating event network-changed:36ca2417-d299-4b53-9b7a-d20e1f7bf431 for instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 on hv-cinder-85265 Aug 09 19:22:27.184832 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-51835d05-109c-49e1-8e3c-7758b9ada1d7 req-529e3731-414b-4373-9236-f90f8b41561c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044851 Aug 09 19:22:27.185448 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 482/960] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:22:27.862197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:27.862709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:27.870009 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:27.870488 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:27.870920 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:27.871609 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:27.872056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:27.872570 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:28.011116 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:28.018786 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8030bc1b-41e2-4c41-ad07-a32b703b1ded tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.160502 Aug 09 19:22:28.019367 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 479/961] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:27 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:29.045032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:29.045755 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:29.052253 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:29.052766 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:29.053194 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:29.053871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:29.054314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:29.054729 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:29.187015 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:29.194594 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-e4fecd29-7696-4aa1-962c-72f2d7b20117 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.154140 Aug 09 19:22:29.195156 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 483/962] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:29 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:30.215082 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:30.215756 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:30.222197 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:30.222692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:30.223128 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:30.223827 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:30.224280 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:30.224748 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:30.359622 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:30.367038 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-64b4e4b6-f6a3-4b25-a2d4-a99dea20b91e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.156700 Aug 09 19:22:30.367629 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 480/963] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:30 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:31.389196 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:31.389727 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:31.399757 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:31.400624 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:31.401324 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:31.402361 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:31.402819 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:31.403246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:31.537051 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:31.545256 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5aa5735b-ed64-45ed-ab98-c3caa42e6693 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.160112 Aug 09 19:22:31.545820 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 484/964] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:31 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:22:32.567212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:32.567867 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:32.575018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:32.575496 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:32.575925 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:32.576648 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:32.577096 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:32.577515 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:32.708489 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:32.717322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a8692c4b-8555-4ed0-9a75-fb7752831ce0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.154063 Aug 09 19:22:32.717897 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 481/965] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:32 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:33.738739 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:33.739322 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:33.746131 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:33.746674 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:33.747188 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:33.747891 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:33.748386 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:33.749437 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:33.889997 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:33.897576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-052a7624-bcb6-4299-85d9-6adea1da3df7 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.163037 Aug 09 19:22:33.898148 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 485/966] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:33 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:34.919909 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:34.920478 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:34.922973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:34.928871 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:34.929360 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:34.929798 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:34.930500 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:34.931023 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:34.931463 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:35.067668 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:35.075405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-facb9de4-0c52-4d16-a0d1-c03472d1593b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.160380 Aug 09 19:22:35.075970 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 482/967] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:34 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:36.096721 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:36.097252 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:36.099204 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:36.099871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=6 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:36.107077 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:36.107633 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:36.108066 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:36.108780 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:36.109224 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:36.109645 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:36.241363 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:36.249541 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ef64d2fe-a149-4baa-8089-27bf0ce1bd8f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.156872 Aug 09 19:22:36.250124 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 486/968] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:36 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:37.270879 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:37.271445 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:37.277885 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:37.278368 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:37.278832 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:37.279521 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:37.279973 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:37.280397 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:37.415799 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:37.423490 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-870bf6ea-05c6-4a4e-8f9d-69b1b1c22201 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.156577 Aug 09 19:22:37.424058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 483/969] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:37 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:38.444450 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:38.445079 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:38.452240 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:38.452762 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:38.453199 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:38.453890 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:38.454345 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:38.454831 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:38.591638 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:38.599174 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d00f1137-3c87-4a6b-ad64-889264d29bfd tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.158580 Aug 09 19:22:38.599750 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 487/970] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:38 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:38.713569 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-2a313beb-1a0e-4d53-9c91-005717399178 req-0ff22e2e-d947-4c0c-ad05-6c094de855e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028f2744-e17b-4d70-9ad5-6e5b665b3442", "name": "network-vif-plugged", "status": "completed", "tag": "36ca2417-d299-4b53-9b7a-d20e1f7bf431"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:38.724091 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-2a313beb-1a0e-4d53-9c91-005717399178 req-0ff22e2e-d947-4c0c-ad05-6c094de855e9 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:38.724642 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-2a313beb-1a0e-4d53-9c91-005717399178 req-0ff22e2e-d947-4c0c-ad05-6c094de855e9 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:38.725118 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-2a313beb-1a0e-4d53-9c91-005717399178 req-0ff22e2e-d947-4c0c-ad05-6c094de855e9 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:38.736584 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-2a313beb-1a0e-4d53-9c91-005717399178 req-0ff22e2e-d947-4c0c-ad05-6c094de855e9 service nova] Creating event network-vif-plugged:36ca2417-d299-4b53-9b7a-d20e1f7bf431 for instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 on hv-cinder-85265 Aug 09 19:22:38.741605 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-2a313beb-1a0e-4d53-9c91-005717399178 req-0ff22e2e-d947-4c0c-ad05-6c094de855e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031759 Aug 09 19:22:38.742905 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 484/971] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:22:39.620922 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:39.621564 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:39.627989 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:39.628504 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:39.628946 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:39.629637 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:39.630088 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:39.630509 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:39.765226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:39.772808 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6d2fa33c-82af-46e1-95b5-9ffad5eabd79 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1265 microversion: 2.1 time: 0.156166 Aug 09 19:22:39.773382 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 488/972] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:39 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:40.796350 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:40.797088 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:40.803232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:40.803713 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:40.804144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:40.805579 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:40.806132 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:40.806562 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:40.939377 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:40.947439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b3007314-b25c-4bb0-a17c-319d01da1b61 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1453 microversion: 2.1 time: 0.155983 Aug 09 19:22:40.948024 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 485/973] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:40 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:22:40.969226 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:40.969876 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:40.970504 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-7ab49aef-edfe-48ac-8cdb-7ca6e49599c0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:40.971000 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-7ab49aef-edfe-48ac-8cdb-7ca6e49599c0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:40.976293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:40.977419 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:40.977616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7ab49aef-edfe-48ac-8cdb-7ca6e49599c0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:40.977911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:40.978101 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7ab49aef-edfe-48ac-8cdb-7ca6e49599c0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:40.978428 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7ab49aef-edfe-48ac-8cdb-7ca6e49599c0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:40.978588 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:40.979039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:40.979152 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7ab49aef-edfe-48ac-8cdb-7ca6e49599c0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:40.979460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:40.979585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7ab49aef-edfe-48ac-8cdb-7ca6e49599c0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:40.979963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-7ab49aef-edfe-48ac-8cdb-7ca6e49599c0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:41.003256 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-7ab49aef-edfe-48ac-8cdb-7ca6e49599c0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/ips" status: 200 len: 151 microversion: 2.1 time: 0.036843 Aug 09 19:22:41.003839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 486/974] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:22:40 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:22:41.112706 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:41.120992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-76ba2054-132e-4d9f-a4e0-926ab4762005 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1453 microversion: 2.1 time: 0.155644 Aug 09 19:22:41.121569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 489/975] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:40 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:42.347526 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d4fd1d5e-06e5-4bfc-88ae-f48f6cc68f2d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:42.349872 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d4fd1d5e-06e5-4bfc-88ae-f48f6cc68f2d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:42.356941 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4fd1d5e-06e5-4bfc-88ae-f48f6cc68f2d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:42.357426 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4fd1d5e-06e5-4bfc-88ae-f48f6cc68f2d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:42.357859 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4fd1d5e-06e5-4bfc-88ae-f48f6cc68f2d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:42.358578 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4fd1d5e-06e5-4bfc-88ae-f48f6cc68f2d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:42.359030 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4fd1d5e-06e5-4bfc-88ae-f48f6cc68f2d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:42.359450 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d4fd1d5e-06e5-4bfc-88ae-f48f6cc68f2d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:42.616987 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d4fd1d5e-06e5-4bfc-88ae-f48f6cc68f2d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273185 Aug 09 19:22:42.623610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 487/976] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:22:42 2022] POST /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:22:42.748888 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-d2b7129a-9509-40eb-8f4e-2c381f04059c req-eb8f1f7e-f6e8-42e5-95cb-c96bf9f1875e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028f2744-e17b-4d70-9ad5-6e5b665b3442", "tag": "36ca2417-d299-4b53-9b7a-d20e1f7bf431"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:42.760026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d2b7129a-9509-40eb-8f4e-2c381f04059c req-eb8f1f7e-f6e8-42e5-95cb-c96bf9f1875e service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:42.760789 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d2b7129a-9509-40eb-8f4e-2c381f04059c req-eb8f1f7e-f6e8-42e5-95cb-c96bf9f1875e service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:42.761262 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-d2b7129a-9509-40eb-8f4e-2c381f04059c req-eb8f1f7e-f6e8-42e5-95cb-c96bf9f1875e service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:42.773433 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-d2b7129a-9509-40eb-8f4e-2c381f04059c req-eb8f1f7e-f6e8-42e5-95cb-c96bf9f1875e service nova] Creating event network-changed:36ca2417-d299-4b53-9b7a-d20e1f7bf431 for instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 on hv-cinder-85265 Aug 09 19:22:42.779120 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-d2b7129a-9509-40eb-8f4e-2c381f04059c req-eb8f1f7e-f6e8-42e5-95cb-c96bf9f1875e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033823 Aug 09 19:22:42.779716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 490/977] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:22:49.121284 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:49.123847 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:49.130808 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:49.131295 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:49.131732 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:49.132418 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:49.133339 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:49.133778 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:49.214645 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Invalid volume: volume 537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0 is already attached to instances: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: POST /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments HTTP/1.1 Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 74 Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:22:49.216548 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {"volumeAttachment": {"volumeId": "537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0"}} Aug 09 19:22:49.218142 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Invalid volume: volume 537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0 is already attached to instances: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'server_id': 'd1ee5dc7-1b26-4fbf-8703-b3c811c80aa4', 'body': {'volumeAttachment': {'volumeId': '537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0'}}} Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0 is already attached to instances: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:49.218962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0 is already attached to instances: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:22:49.220963 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:22:49.222623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:22:49.222623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:22:49.222623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:22:49.222623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0 is already attached to instances: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 Aug 09 19:22:49.222623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:22:49.222623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 400 to user: Invalid volume: volume 537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0 is already attached to instances: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:22:49.222623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b7577bde-68b8-455f-b43a-842c07c6ea13 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102076 Aug 09 19:22:49.222623 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 488/978] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:22:49 2022] POST /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 19:22:49.284149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:49.284770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:49.291651 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:49.292132 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:49.292608 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:49.293293 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:49.294025 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:49.294426 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:49.376133 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lazy-loading 'services' on Instance uuid d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:22:49.452192 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7ce81311-45b1-458a-8f99-353bed235659 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments/537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0" status: 202 len: 0 microversion: 2.1 time: 0.172019 Aug 09 19:22:49.453064 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 491/979] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:22:49 2022] DELETE /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments/537f7ce7-0ad9-4f23-a03b-4fb5dd1a5fd0 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:22:49.462139 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-67d807b7-b779-4976-834f-415bd4841d81 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:49.464587 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-67d807b7-b779-4976-834f-415bd4841d81 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:49.472202 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67d807b7-b779-4976-834f-415bd4841d81 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:49.472810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67d807b7-b779-4976-834f-415bd4841d81 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:49.473249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67d807b7-b779-4976-834f-415bd4841d81 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:49.473945 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67d807b7-b779-4976-834f-415bd4841d81 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:49.474395 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67d807b7-b779-4976-834f-415bd4841d81 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:49.474818 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-67d807b7-b779-4976-834f-415bd4841d81 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:49.505311 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-67d807b7-b779-4976-834f-415bd4841d81 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047851 Aug 09 19:22:49.505866 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 489/980] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:22:49 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:22:50.519824 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b22659c1-933b-457b-aee4-39c6d87d176b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:50.522088 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b22659c1-933b-457b-aee4-39c6d87d176b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:50.528964 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b22659c1-933b-457b-aee4-39c6d87d176b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:50.529716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b22659c1-933b-457b-aee4-39c6d87d176b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:50.530144 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b22659c1-933b-457b-aee4-39c6d87d176b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:50.530829 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b22659c1-933b-457b-aee4-39c6d87d176b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:50.531276 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b22659c1-933b-457b-aee4-39c6d87d176b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:50.531691 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b22659c1-933b-457b-aee4-39c6d87d176b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:50.562820 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b22659c1-933b-457b-aee4-39c6d87d176b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047883 Aug 09 19:22:50.563376 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 492/981] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:22:50 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:22:50.624606 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:50.625144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:50.632098 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:50.633392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:50.633909 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:50.635113 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:50.635587 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:50.636016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:50.663629 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:22:50.739317 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-2e3222aa-926d-46e2-a452-e69f969c8ef7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 204 len: 0 microversion: 2.1 time: 0.118381 Aug 09 19:22:50.740076 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 490/982] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:22:50 2022] DELETE /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:22:50.749072 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:50.749680 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:50.755622 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:50.756099 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:50.756557 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:50.757241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:50.758479 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:50.759035 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:50.889868 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:50.897372 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6457fb41-0a22-4b61-b85a-387817b84d49 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1683 microversion: 2.1 time: 0.152206 Aug 09 19:22:50.897932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 493/983] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:50 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:22:51.919744 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:51.920473 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:51.926917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:51.927399 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:51.927837 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:51.928557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:51.929011 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:51.929440 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:52.063865 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:52.072598 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e8673eb5-6d98-47b2-a13a-150daa3991fd tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1683 microversion: 2.1 time: 0.157383 Aug 09 19:22:52.073344 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 491/984] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:51 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:53.094577 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:53.095187 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:53.102417 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:53.102893 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:53.103319 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:53.104003 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:53.104462 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:53.104889 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:53.203977 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:53.212136 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-875d0902-583e-498f-8b04-e449fd9177b1 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 200 len: 1615 microversion: 2.1 time: 0.121807 Aug 09 19:22:53.212743 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 494/985] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:53 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 1615 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:22:53.440465 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-3bbc47a9-11e6-4cbb-a554-ed31d1ba20ae req-fba4cdc3-8354-4d7b-8302-5de50f8f0adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4", "name": "network-vif-deleted", "tag": "392babf4-74c7-4258-8824-c122d7bfb3be"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:53.460473 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-3bbc47a9-11e6-4cbb-a554-ed31d1ba20ae req-fba4cdc3-8354-4d7b-8302-5de50f8f0adc service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:53.461785 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-3bbc47a9-11e6-4cbb-a554-ed31d1ba20ae req-fba4cdc3-8354-4d7b-8302-5de50f8f0adc service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:53.462345 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-3bbc47a9-11e6-4cbb-a554-ed31d1ba20ae req-fba4cdc3-8354-4d7b-8302-5de50f8f0adc service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:53.476912 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-3bbc47a9-11e6-4cbb-a554-ed31d1ba20ae req-fba4cdc3-8354-4d7b-8302-5de50f8f0adc service nova] Creating event network-vif-deleted:392babf4-74c7-4258-8824-c122d7bfb3be for instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 on hv-cinder-85265 Aug 09 19:22:53.482393 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-3bbc47a9-11e6-4cbb-a554-ed31d1ba20ae req-fba4cdc3-8354-4d7b-8302-5de50f8f0adc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048495 Aug 09 19:22:53.483328 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 492/986] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:22:54.235307 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:54.235973 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:54.238527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:54.245201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:54.245695 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:54.246122 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:54.246848 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:54.247434 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:54.247689 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:54.251140 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:54.264223 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 HTTP/1.1 Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:22:54.265918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:22:54.267534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'd1ee5dc7-1b26-4fbf-8703-b3c811c80aa4'} Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:22:54.268351 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:22:54.270000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:22:54.271642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:22:54.271642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d33cdfa6-b717-4cca-a3fd-b46f84ff0929 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 404 len: 111 microversion: 2.1 time: 0.035975 Aug 09 19:22:54.271642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 495/987] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:54 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:22:54.277098 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-53c8c9de-8e24-4cde-af72-82154d5cbdf0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '.version_select at 0x7fa5080f2430>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:54.297405 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-53c8c9de-8e24-4cde-af72-82154d5cbdf0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-450919147" status: 202 len: 0 microversion: 2.1 time: 0.024644 Aug 09 19:22:54.297990 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 493/988] 10.222.0.70 () {58 vars in 1218 bytes} [Tue Aug 9 19:22:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-450919147 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:22:54.926482 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9af593ba-fd10-4925-9df6-defda9849d25 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: .version_select at 0x7fa5036d2820>, body: {"keypair": {"name": "tempest-keypair-1778259901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLTlielFuk7IF1gCCXBREFodrx8Hj+gIf1ILvcghLmXVxsi/OvSuMko3PGd1zAbixq82R8FNPTqWXEjdnsQ8axW5Wltliqm1bhAQB1O8e9GGAwpeemkKdMBlecAD837aQ=="}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:54.942497 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-9af593ba-fd10-4925-9df6-defda9849d25 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for project 46afad886ad34608b533f4ee80a18ba5. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:22:54.946522 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.quota [None req-9af593ba-fd10-4925-9df6-defda9849d25 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for user 4f7899ab15b347b7be75e3433f0d5450 and project 46afad886ad34608b533f4ee80a18ba5. Resources: {'key_pairs'} {{(pid=117823) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:22:54.969439 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-9af593ba-fd10-4925-9df6-defda9849d25 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046808 Aug 09 19:22:54.975894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 496/989] 10.222.0.70 () {60 vars in 1159 bytes} [Tue Aug 9 19:22:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:22:56.403175 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1196658851", "imageRef": "8b561908-708b-488f-896b-cc3917c47cf6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f05d1eed-0f4c-4655-a75a-07649579d361"}], "security_groups": [{"name": "tempest-securitygroup--232875135"}], "key_name": "tempest-keypair-1778259901", "user_data": "}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:56.410944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:56.508665 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.network.neutron [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] validate_networks() for [('f05d1eed-0f4c-4655-a75a-07649579d361', None, None, None, None, None)] {{(pid=117822) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 19:22:56.875906 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Flavor limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 19:22:56.876334 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Image limits 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 19:22:56.876843 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Flavor pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 19:22:56.877260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Image pref 0:0:0 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 19:22:56.877673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.virt.hardware [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117822) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 19:22:56.887043 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:56.887526 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:56.887965 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:56.888811 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:56.889269 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:56.889696 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:56.896401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:22:56.909947 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for project 46afad886ad34608b533f4ee80a18ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 19:22:56.915291 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.quota [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Getting quotas for user 4f7899ab15b347b7be75e3433f0d5450 and project 46afad886ad34608b533f4ee80a18ba5. Resources: {'ram', 'instances', 'cores'} {{(pid=117822) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 19:22:56.926485 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Going to run 1 instances... {{(pid=117822) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 19:22:56.928903 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b561908-708b-488f-896b-cc3917c47cf6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117822) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 19:22:56.974571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fb65bf82-d2df-413d-b948-9db11fe6995e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.577062 Aug 09 19:22:56.975224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 494/990] 10.222.0.70 () {60 vars in 1147 bytes} [Tue Aug 9 19:22:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 19:22:56.987412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-df281031-0bb0-4fac-9422-f991d1aedaa7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:56.988029 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-df281031-0bb0-4fac-9422-f991d1aedaa7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:57.043247 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-df281031-0bb0-4fac-9422-f991d1aedaa7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:57.050572 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-df281031-0bb0-4fac-9422-f991d1aedaa7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1242 microversion: 2.1 time: 0.067544 Aug 09 19:22:57.051136 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 497/991] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:56 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:58.072370 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:58.073024 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:58.081999 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:58.082493 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:58.082931 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:58.083761 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:58.084214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:58.084685 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:58.152275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:58.160148 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-e1333867-554a-40d5-9551-b9d6fab9bec9 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1312 microversion: 2.1 time: 0.092865 Aug 09 19:22:58.160743 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 495/992] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:58 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:59.182445 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:22:59.183062 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:22:59.189718 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:59.190208 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:59.190643 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:59.191353 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:59.191806 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:59.192233 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:59.509730 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:22:59.517304 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-b8a9697b-ce60-41e2-99f0-9c4b74c4f142 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1367 microversion: 2.1 time: 0.339305 Aug 09 19:22:59.517960 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 498/993] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:22:59 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:22:59.594335 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-964b1c69-0d73-43d5-9ef6-f74b2c53cfad req-8bb920a4-4616-4f47-ade7-6fb46078ba5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d1147b8-6a46-4f73-9f58-f2130429d89d", "tag": "fdf7c5e1-fb55-41fd-95e1-16825f3a54b3"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:22:59.605761 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-964b1c69-0d73-43d5-9ef6-f74b2c53cfad req-8bb920a4-4616-4f47-ade7-6fb46078ba5b service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:22:59.606245 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-964b1c69-0d73-43d5-9ef6-f74b2c53cfad req-8bb920a4-4616-4f47-ade7-6fb46078ba5b service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:22:59.606683 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-964b1c69-0d73-43d5-9ef6-f74b2c53cfad req-8bb920a4-4616-4f47-ade7-6fb46078ba5b service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:22:59.619103 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-964b1c69-0d73-43d5-9ef6-f74b2c53cfad req-8bb920a4-4616-4f47-ade7-6fb46078ba5b service nova] Creating event network-changed:fdf7c5e1-fb55-41fd-95e1-16825f3a54b3 for instance 9d1147b8-6a46-4f73-9f58-f2130429d89d on hv-cinder-85265 Aug 09 19:22:59.623763 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-964b1c69-0d73-43d5-9ef6-f74b2c53cfad req-8bb920a4-4616-4f47-ade7-6fb46078ba5b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033174 Aug 09 19:22:59.624371 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 496/994] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:23:00.539325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:00.539853 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:00.546638 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:00.547118 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:00.547547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:00.548235 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:00.548726 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:00.549149 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:00.676511 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:23:00.684679 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ea08734b-74a1-4d18-91e2-17f1ba9827bf tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1367 microversion: 2.1 time: 0.149363 Aug 09 19:23:00.685250 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 499/995] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:00 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:23:01.706814 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:01.707524 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:01.714787 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:01.715268 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:01.715698 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:01.716387 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:01.716877 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:01.717317 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:01.850649 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:23:01.858649 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-dda8b9d5-4309-4f0c-8f3d-201ecd712994 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1367 microversion: 2.1 time: 0.156651 Aug 09 19:23:01.859212 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 497/996] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:01 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:23:02.879100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:02.879716 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:02.887026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:02.887506 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:02.887941 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:02.888685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:02.889142 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:02.889564 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:03.020808 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:23:03.028695 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-d247186d-3202-40fc-b932-fa7923654466 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1367 microversion: 2.1 time: 0.153422 Aug 09 19:23:03.029270 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 500/997] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:02 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:23:04.050622 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:04.051687 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:04.063065 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:04.063549 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:04.063979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:04.064886 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:04.065347 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:04.068153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:04.199044 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:23:04.206523 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-652ff0d4-bda5-44d3-b6ca-6cb0d6294b1e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1367 microversion: 2.1 time: 0.160134 Aug 09 19:23:04.207101 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 498/998] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:04 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:23:04.774901 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-9372013b-ecf7-4174-875b-e3f5b9677a76 req-90a04f92-48ba-4ade-94ba-b62cb9be343c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1147b8-6a46-4f73-9f58-f2130429d89d", "name": "network-vif-plugged", "status": "completed", "tag": "fdf7c5e1-fb55-41fd-95e1-16825f3a54b3"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:23:04.786518 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-9372013b-ecf7-4174-875b-e3f5b9677a76 req-90a04f92-48ba-4ade-94ba-b62cb9be343c service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:04.787023 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-9372013b-ecf7-4174-875b-e3f5b9677a76 req-90a04f92-48ba-4ade-94ba-b62cb9be343c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:04.787418 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-9372013b-ecf7-4174-875b-e3f5b9677a76 req-90a04f92-48ba-4ade-94ba-b62cb9be343c service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:04.801412 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-9372013b-ecf7-4174-875b-e3f5b9677a76 req-90a04f92-48ba-4ade-94ba-b62cb9be343c service nova] Creating event network-vif-plugged:fdf7c5e1-fb55-41fd-95e1-16825f3a54b3 for instance 9d1147b8-6a46-4f73-9f58-f2130429d89d on hv-cinder-85265 Aug 09 19:23:04.806653 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-9372013b-ecf7-4174-875b-e3f5b9677a76 req-90a04f92-48ba-4ade-94ba-b62cb9be343c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036995 Aug 09 19:23:04.807512 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 501/999] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:23:05.227238 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:05.227846 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:05.234286 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:05.234765 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:05.235195 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:05.235937 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:05.236371 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:05.236877 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:05.370673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:23:05.378053 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-da7f6330-17a5-4777-a41f-53880217156a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1367 microversion: 2.1 time: 0.154770 Aug 09 19:23:05.378618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 499/1000] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:05 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:23:06.399880 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:06.400619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:06.407404 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:06.407891 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:06.408321 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:06.409052 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:06.409500 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:06.409918 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:06.544585 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:23:06.552780 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-36c55cc4-a20a-43f7-8763-dfb513cd9a00 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1557 microversion: 2.1 time: 0.157701 Aug 09 19:23:06.553360 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 502/1001] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:06 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:23:06.573940 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-1d18b7e1-4077-4e20-99c1-c565a2a53985 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:06.574515 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-1d18b7e1-4077-4e20-99c1-c565a2a53985 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:06.580872 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d18b7e1-4077-4e20-99c1-c565a2a53985 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:06.581348 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d18b7e1-4077-4e20-99c1-c565a2a53985 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:06.581773 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d18b7e1-4077-4e20-99c1-c565a2a53985 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:06.582451 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d18b7e1-4077-4e20-99c1-c565a2a53985 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:06.582967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d18b7e1-4077-4e20-99c1-c565a2a53985 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:06.583394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-1d18b7e1-4077-4e20-99c1-c565a2a53985 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:06.661930 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-1d18b7e1-4077-4e20-99c1-c565a2a53985 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092178 Aug 09 19:23:06.662529 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 500/1002] 10.222.0.70 () {58 vars in 1275 bytes} [Tue Aug 9 19:23:06 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:23:07.853586 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-419d8fa2-ed8e-46bf-9860-0372ce8746ad req-3d996ba2-00d9-4368-892d-c0797b27d0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d1147b8-6a46-4f73-9f58-f2130429d89d", "tag": "fdf7c5e1-fb55-41fd-95e1-16825f3a54b3"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:23:07.858403 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell0:SELECT=6 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:07.864576 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-419d8fa2-ed8e-46bf-9860-0372ce8746ad req-3d996ba2-00d9-4368-892d-c0797b27d0c6 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:07.865061 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-419d8fa2-ed8e-46bf-9860-0372ce8746ad req-3d996ba2-00d9-4368-892d-c0797b27d0c6 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:07.865491 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-419d8fa2-ed8e-46bf-9860-0372ce8746ad req-3d996ba2-00d9-4368-892d-c0797b27d0c6 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:07.876796 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-419d8fa2-ed8e-46bf-9860-0372ce8746ad req-3d996ba2-00d9-4368-892d-c0797b27d0c6 service nova] Creating event network-changed:fdf7c5e1-fb55-41fd-95e1-16825f3a54b3 for instance 9d1147b8-6a46-4f73-9f58-f2130429d89d on hv-cinder-85265 Aug 09 19:23:07.881623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-419d8fa2-ed8e-46bf-9860-0372ce8746ad req-3d996ba2-00d9-4368-892d-c0797b27d0c6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031921 Aug 09 19:23:07.882913 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 503/1003] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:23:43.846377 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=2 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:43.847210 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell0:SELECT=6 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:43.848540 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:43.849171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=31 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:43.853454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-6d548538-5cef-4a33-9be6-d68826ac641a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:43.853945 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-6d548538-5cef-4a33-9be6-d68826ac641a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:43.862004 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6d548538-5cef-4a33-9be6-d68826ac641a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:43.862501 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6d548538-5cef-4a33-9be6-d68826ac641a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:43.862926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6d548538-5cef-4a33-9be6-d68826ac641a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:43.863616 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6d548538-5cef-4a33-9be6-d68826ac641a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:43.864062 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6d548538-5cef-4a33-9be6-d68826ac641a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:43.864507 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-6d548538-5cef-4a33-9be6-d68826ac641a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:43.889812 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-6d548538-5cef-4a33-9be6-d68826ac641a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/ips" status: 200 len: 150 microversion: 2.1 time: 0.044250 Aug 09 19:23:43.890389 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 501/1004] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:23:43 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:23:45.218906 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:45.219708 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=29 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:23:45.224156 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-24a6e226-2b84-480b-9ef0-775683b5d80f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "662bf2ca-2971-4f8a-a642-19be775a89ab"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:23:45.226608 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-24a6e226-2b84-480b-9ef0-775683b5d80f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:45.234145 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24a6e226-2b84-480b-9ef0-775683b5d80f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:45.234609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24a6e226-2b84-480b-9ef0-775683b5d80f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:45.235036 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24a6e226-2b84-480b-9ef0-775683b5d80f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:45.235722 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24a6e226-2b84-480b-9ef0-775683b5d80f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:45.236165 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24a6e226-2b84-480b-9ef0-775683b5d80f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:45.236619 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-24a6e226-2b84-480b-9ef0-775683b5d80f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:45.480562 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-24a6e226-2b84-480b-9ef0-775683b5d80f tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "POST /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263083 Aug 09 19:23:45.481179 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 504/1005] 10.222.0.70 () {60 vars in 1323 bytes} [Tue Aug 9 19:23:45 2022] POST /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:23:53.098822 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:53.099476 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:53.106741 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:53.107228 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:53.107669 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:53.108367 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:53.108853 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:53.109285 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:53.191298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lazy-loading 'services' on Instance uuid 9d1147b8-6a46-4f73-9f58-f2130429d89d {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:23:53.265736 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a92c1db5-b7d5-48ae-bd32-6bba96c342b7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-volume_attachments/662bf2ca-2971-4f8a-a642-19be775a89ab" status: 202 len: 0 microversion: 2.1 time: 0.170644 Aug 09 19:23:53.266374 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 502/1006] 10.222.0.70 () {58 vars in 1416 bytes} [Tue Aug 9 19:23:53 2022] DELETE /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-volume_attachments/662bf2ca-2971-4f8a-a642-19be775a89ab => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:23:53.275258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-5321a073-3629-4d80-b1bb-dc51bb12e24c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:53.277683 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-5321a073-3629-4d80-b1bb-dc51bb12e24c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:53.284401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5321a073-3629-4d80-b1bb-dc51bb12e24c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:53.284980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5321a073-3629-4d80-b1bb-dc51bb12e24c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:53.285442 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5321a073-3629-4d80-b1bb-dc51bb12e24c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:53.286148 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5321a073-3629-4d80-b1bb-dc51bb12e24c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:53.286602 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5321a073-3629-4d80-b1bb-dc51bb12e24c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:53.287103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-5321a073-3629-4d80-b1bb-dc51bb12e24c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:53.319015 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-5321a073-3629-4d80-b1bb-dc51bb12e24c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048058 Aug 09 19:23:53.319587 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 505/1007] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:23:53 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:23:54.331775 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-fd4236a8-4d38-48f1-aa82-22161a5f5185 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:54.334125 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-fd4236a8-4d38-48f1-aa82-22161a5f5185 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:54.340930 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fd4236a8-4d38-48f1-aa82-22161a5f5185 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:54.341407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fd4236a8-4d38-48f1-aa82-22161a5f5185 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:54.341841 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fd4236a8-4d38-48f1-aa82-22161a5f5185 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:54.342528 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fd4236a8-4d38-48f1-aa82-22161a5f5185 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:54.342972 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fd4236a8-4d38-48f1-aa82-22161a5f5185 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:54.343388 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-fd4236a8-4d38-48f1-aa82-22161a5f5185 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:54.372494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-fd4236a8-4d38-48f1-aa82-22161a5f5185 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045656 Aug 09 19:23:54.373071 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 503/1008] 10.222.0.70 () {58 vars in 1302 bytes} [Tue Aug 9 19:23:54 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 19:23:54.435463 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:54.435974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:54.442238 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:54.442715 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:54.443142 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:54.443818 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:54.444262 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:54.444705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:54.469570 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:23:54.543449 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-230ef38e-6560-4d0e-b464-cd8735bfefe0 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 204 len: 0 microversion: 2.1 time: 0.110686 Aug 09 19:23:54.544101 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 506/1009] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:23:54 2022] DELETE /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:23:54.552191 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:54.552832 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:54.558936 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:54.559420 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:54.559852 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:54.560569 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:54.561020 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:54.561442 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:54.868913 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:23:54.877019 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-86f12b51-31af-4435-882f-fef40c27b73e tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1682 microversion: 2.1 time: 0.328666 Aug 09 19:23:54.877588 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 504/1010] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:54 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1682 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:23:55.899161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:55.899856 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:55.907082 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:55.907559 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:55.907980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:55.908778 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:55.909225 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:55.909639 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:56.107847 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:23:56.115487 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7352e36b-5794-4635-b7d3-646034b0652d tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1682 microversion: 2.1 time: 0.220594 Aug 09 19:23:56.116060 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 507/1011] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:55 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1682 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:23:57.137375 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:57.138021 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:57.145666 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:57.146153 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:57.146585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:57.147349 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:57.147821 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:57.148583 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:57.221111 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f7899ab15b347b7be75e3433f0d5450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad886ad34608b533f4ee80a18ba5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:23:57.231926 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-bc81b29f-c183-4e82-9844-181d970048c7 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 200 len: 1615 microversion: 2.1 time: 0.099034 Aug 09 19:23:57.232516 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 505/1012] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:57 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 1615 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:23:57.469911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-7b8ad7d7-1645-455f-b02a-e2bbb92659ba req-ab1c62e3-3d3f-4b98-aa62-7c0691e12be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1147b8-6a46-4f73-9f58-f2130429d89d", "name": "network-vif-deleted", "tag": "fdf7c5e1-fb55-41fd-95e1-16825f3a54b3"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:23:57.481478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-7b8ad7d7-1645-455f-b02a-e2bbb92659ba req-ab1c62e3-3d3f-4b98-aa62-7c0691e12be2 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:57.481969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-7b8ad7d7-1645-455f-b02a-e2bbb92659ba req-ab1c62e3-3d3f-4b98-aa62-7c0691e12be2 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:57.483042 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-7b8ad7d7-1645-455f-b02a-e2bbb92659ba req-ab1c62e3-3d3f-4b98-aa62-7c0691e12be2 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:57.496152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-7b8ad7d7-1645-455f-b02a-e2bbb92659ba req-ab1c62e3-3d3f-4b98-aa62-7c0691e12be2 service nova] Creating event network-vif-deleted:fdf7c5e1-fb55-41fd-95e1-16825f3a54b3 for instance 9d1147b8-6a46-4f73-9f58-f2130429d89d on hv-cinder-85265 Aug 09 19:23:57.503601 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-7b8ad7d7-1645-455f-b02a-e2bbb92659ba req-ab1c62e3-3d3f-4b98-aa62-7c0691e12be2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038048 Aug 09 19:23:57.504636 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 508/1013] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:23:58.253336 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:58.253952 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:23:58.261962 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:58.262810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:58.263249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:58.264016 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:23:58.264413 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:23:58.266400 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:23:58.282407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d HTTP/1.1 Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:23:58.284081 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:23:58.285752 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '9d1147b8-6a46-4f73-9f58-f2130429d89d'} Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:23:58.286608 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:23:58.288059 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:23:58.289757 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:23:58.289757 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b96f4d75-4899-40b4-9fcd-d777d91a1695 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 404 len: 111 microversion: 2.1 time: 0.036128 Aug 09 19:23:58.289757 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 506/1014] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:23:58 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:23:58.298471 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c64db096-a9c3-4e4d-b00d-4ec009b35703 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '.version_select at 0x7fa50367a280>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:23:58.318432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c64db096-a9c3-4e4d-b00d-4ec009b35703 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778259901" status: 202 len: 0 microversion: 2.1 time: 0.027154 Aug 09 19:23:58.320775 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 509/1015] 10.222.0.70 () {58 vars in 1221 bytes} [Tue Aug 9 19:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778259901 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:24:00.079310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:00.079788 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:00.085726 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:00.086209 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:00.086643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:00.087321 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:00.087769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:00.088189 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:00.101439 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d HTTP/1.1 Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:24:00.102986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.105136 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '9d1147b8-6a46-4f73-9f58-f2130429d89d'} Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:00.108856 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.110357 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.111907 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:00.111907 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0787794d-7e71-447f-b888-029dd4cd108b tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 404 len: 111 microversion: 2.1 time: 0.029057 Aug 09 19:24:00.111907 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 507/1016] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:24:00 2022] DELETE /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:00.113823 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:00.114562 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 9d1147b8-6a46-4f73-9f58-f2130429d89d] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:00.122207 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:00.122685 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:00.123121 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:00.123898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:00.124355 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:00.124807 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:00.138099 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d HTTP/1.1 Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:24:00.139707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.141272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': '9d1147b8-6a46-4f73-9f58-f2130429d89d'} Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:00.142093 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. Aug 09 19:24:00.143309 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:00.144433 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance 9d1147b8-6a46-4f73-9f58-f2130429d89d could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:00.144433 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6b22b478-12ac-488d-8a77-781a06b6c95a tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d" status: 404 len: 111 microversion: 2.1 time: 0.031763 Aug 09 19:24:00.144433 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 510/1017] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:00 2022] GET /compute/v2.1/servers/9d1147b8-6a46-4f73-9f58-f2130429d89d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:01.282364 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:01.282865 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:01.289224 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:01.289695 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:01.290123 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:01.290805 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:01.291251 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:01.291673 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:01.305249 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 HTTP/1.1 Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:24:01.306783 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.308919 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'd1ee5dc7-1b26-4fbf-8703-b3c811c80aa4'} Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:01.309875 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.311517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.313135 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:01.313135 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-a6f8b559-2669-45e3-8ff9-e2cf0d7da390 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 404 len: 111 microversion: 2.1 time: 0.030143 Aug 09 19:24:01.313135 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 508/1018] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:24:01 2022] DELETE /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:01.317046 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:01.317597 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:01.324683 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:01.325152 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:01.325573 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:01.326253 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:01.326700 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:01.327114 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:01.340789 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 HTTP/1.1 Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:24:01.342289 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.343894 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'd1ee5dc7-1b26-4fbf-8703-b3c811c80aa4'} Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:01.344821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. Aug 09 19:24:01.346330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.347882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:01.347882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-9cc30539-3c4b-4f1f-889b-82eb6e047095 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4" status: 404 len: 111 microversion: 2.1 time: 0.030466 Aug 09 19:24:01.347882 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 511/1019] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:01 2022] GET /compute/v2.1/servers/d1ee5dc7-1b26-4fbf-8703-b3c811c80aa4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:01.351968 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:01.352480 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:01.359176 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:01.359660 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:01.360094 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:01.360819 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:01.361282 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:01.361704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:01.376868 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 HTTP/1.1 Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:24:01.378402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.380056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': 'a8480c7c-419e-4968-9b71-1e79ad47a8f1'} Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:01.380979 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.387659 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.390163 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:01.390163 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c04116d2-be4f-40d3-a6cf-27c0118fab82 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 404 len: 111 microversion: 2.1 time: 0.031641 Aug 09 19:24:01.390163 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 509/1020] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:24:01 2022] DELETE /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:01.390960 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:01.390960 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: a8480c7c-419e-4968-9b71-1e79ad47a8f1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:01.395796 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:01.396275 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:01.396737 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:01.397432 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:01.397878 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:01.398295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:01.412252 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 HTTP/1.1 Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:24:01.413805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.415409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': 'a8480c7c-419e-4968-9b71-1e79ad47a8f1'} Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:01.416350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. Aug 09 19:24:01.417971 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:01.419905 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance a8480c7c-419e-4968-9b71-1e79ad47a8f1 could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:01.419905 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-817473c7-f1dc-4764-879e-3250d7763cb5 tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1" status: 404 len: 111 microversion: 2.1 time: 0.030823 Aug 09 19:24:01.419905 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 512/1021] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:01 2022] GET /compute/v2.1/servers/a8480c7c-419e-4968-9b71-1e79ad47a8f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:02.551235 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:02.551755 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:02.558199 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:02.558677 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:02.559112 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:02.559800 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:02.560252 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:02.560703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:02.573942 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c HTTP/1.1 Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:24:02.575459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.577214 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '3a42acc3-2c59-41b1-aaf2-323a41f9a49c'} Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:02.578275 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.579944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.581550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:02.581550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b0a472ff-8b27-4f46-9f25-a25d13d24f2c tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 404 len: 111 microversion: 2.1 time: 0.029415 Aug 09 19:24:02.581550 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 510/1022] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:24:02 2022] DELETE /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:02.585268 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:02.585878 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] [instance: 3a42acc3-2c59-41b1-aaf2-323a41f9a49c] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:02.592530 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:02.593000 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:02.593425 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:02.594098 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:02.594541 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:02.594955 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:02.608934 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] HTTP exception thrown: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Request method failure captured: Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c HTTP/1.1 Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rM4r6f6XhgXxCPlIe54pyeZ869Vjj_8U267cBYQrjjsPOSafLTuhwA8JfjbkjL4ZJGUEZm40z-XkAfAsFUGuQcoHvcULlphd1QJai-wpt1GjD_stVgK8l5PhiFOxyh-ckHBSQJ96Mq6_c81OQFRZnHC2jAPWMHR2ZOZBks_tK2Q5FE Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:24:02.610402 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad886ad34608b533f4ee80a18ba5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad886ad34608b533f4ee80a18ba5"}]}] Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 46afad886ad34608b533f4ee80a18ba5 Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-179807130 Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 4f7899ab15b347b7be75e3433f0d5450 Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-AttachVolumeNegativeTest-179807130-project Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.612012 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': '3a42acc3-2c59-41b1-aaf2-323a41f9a49c'} Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:02.613039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. Aug 09 19:24:02.614543 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:02.615938 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] Returning 404 to user: Instance 3a42acc3-2c59-41b1-aaf2-323a41f9a49c could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:02.615938 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-45b2b1c4-3ac7-4282-b027-6ca7a84402ed tempest-AttachVolumeNegativeTest-179807130 tempest-AttachVolumeNegativeTest-179807130-project] 10.222.0.70 "GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c" status: 404 len: 111 microversion: 2.1 time: 0.030300 Aug 09 19:24:02.615938 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 513/1023] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:02 2022] GET /compute/v2.1/servers/3a42acc3-2c59-41b1-aaf2-323a41f9a49c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:07.045396 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-05b7f323-32ac-4b05-95b5-90294dd2c574 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Action: 'create', calling method: .version_select at 0x7fa508282a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1973810093"}} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:07.347202 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-05b7f323-32ac-4b05-95b5-90294dd2c574 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.417690 Aug 09 19:24:07.347834 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 511/1024] 10.222.0.70 () {60 vars in 1155 bytes} [Tue Aug 9 19:24:06 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 19:24:07.360332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-426ee0e0-d1de-4a16-b375-bac1de773b5d tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa50802fd30>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:07.411350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-426ee0e0-d1de-4a16-b375-bac1de773b5d tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef" status: 200 len: 345 microversion: 2.1 time: 0.055104 Aug 09 19:24:07.411928 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 514/1025] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:24:07 2022] GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:08.426982 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d79f7425-d6c8-4df0-a7b7-6d7ef7613d61 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa508273d30>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:08.475507 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d79f7425-d6c8-4df0-a7b7-6d7ef7613d61 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef" status: 200 len: 346 microversion: 2.1 time: 0.052793 Aug 09 19:24:08.476133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 512/1026] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:24:08 2022] GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:08.489350 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6e90260d-5b36-4267-ac57-ebbf9f445342 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Action: 'create', calling method: .version_select at 0x7fa5037a2e50>, body: {"snapshot": {"volume_id": "865116e8-d60e-44e5-a8aa-f19ae9b1bcef", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-250810539"}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:08.639103 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6e90260d-5b36-4267-ac57-ebbf9f445342 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.154046 Aug 09 19:24:08.639693 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 515/1027] 10.222.0.70 () {60 vars in 1162 bytes} [Tue Aug 9 19:24:08 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:08.650454 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-71ba07f1-0e4e-4654-a164-ac256e43b6a0 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa5081d8430>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:08.681220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-71ba07f1-0e4e-4654-a164-ac256e43b6a0 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3" status: 200 len: 286 microversion: 2.1 time: 0.034696 Aug 09 19:24:08.681785 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 513/1028] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Aug 9 19:24:08 2022] GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:08.692830 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-20ba8f2a-050d-4c7b-b2fe-ca4bab04d053 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa5037e35e0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:08.723392 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-20ba8f2a-050d-4c7b-b2fe-ca4bab04d053 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.034433 Aug 09 19:24:08.723962 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 516/1029] 10.222.0.70 () {58 vars in 1140 bytes} [Tue Aug 9 19:24:08 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:08.735577 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4d175a1e-08f3-4dec-b606-f9d8ccd5f731 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa508102ca0>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:08.764277 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4d175a1e-08f3-4dec-b606-f9d8ccd5f731 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3" status: 200 len: 286 microversion: 2.1 time: 0.032401 Aug 09 19:24:08.764885 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 514/1030] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Aug 9 19:24:08 2022] GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:24:09.778050 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c29cdbbd-cbc3-49b3-8855-4e257be8156d tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa5037cf1f0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:09.808627 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c29cdbbd-cbc3-49b3-8855-4e257be8156d tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3" status: 200 len: 286 microversion: 2.1 time: 0.035525 Aug 09 19:24:09.809185 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 517/1031] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Aug 9 19:24:09 2022] GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:10.820768 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-60548b80-2d8a-4682-977d-aa5aa64fc1e4 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa508173430>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:10.851559 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-60548b80-2d8a-4682-977d-aa5aa64fc1e4 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3" status: 200 len: 286 microversion: 2.1 time: 0.035109 Aug 09 19:24:10.852121 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 515/1032] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Aug 9 19:24:10 2022] GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:11.362311 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:11.367591 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-5ee26683-c423-48e6-8762-7557e452ce55 req-26cb2a8c-0f18-4574-af14-6b061176eeb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "028f2744-e17b-4d70-9ad5-6e5b665b3442", "tag": "36ca2417-d299-4b53-9b7a-d20e1f7bf431"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:11.373536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:11.380390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-5ee26683-c423-48e6-8762-7557e452ce55 req-26cb2a8c-0f18-4574-af14-6b061176eeb7 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:11.380592 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:11.380898 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-5ee26683-c423-48e6-8762-7557e452ce55 req-26cb2a8c-0f18-4574-af14-6b061176eeb7 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:11.381070 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:11.381322 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-5ee26683-c423-48e6-8762-7557e452ce55 req-26cb2a8c-0f18-4574-af14-6b061176eeb7 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:11.381445 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:11.382045 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:11.382673 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:11.383117 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:11.395656 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-5ee26683-c423-48e6-8762-7557e452ce55 req-26cb2a8c-0f18-4574-af14-6b061176eeb7 service nova] Creating event network-changed:36ca2417-d299-4b53-9b7a-d20e1f7bf431 for instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 on hv-cinder-85265 Aug 09 19:24:11.400764 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-5ee26683-c423-48e6-8762-7557e452ce55 req-26cb2a8c-0f18-4574-af14-6b061176eeb7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036632 Aug 09 19:24:11.401366 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 516/1033] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:11.412213 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Going to try to terminate instance {{(pid=117823) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:24:11.489665 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-31a16d12-01f5-4a84-be2b-1ecf713344a9 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "DELETE /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 204 len: 0 microversion: 2.1 time: 0.131736 Aug 09 19:24:11.490401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 518/1034] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:24:11 2022] DELETE /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:24:11.499829 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:11.500637 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:11.506826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:11.507705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:11.507705 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:11.508412 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:11.508899 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:11.509317 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:11.647780 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:11.657332 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-eee6377e-c734-4dcf-bf4d-0ec5cb20874d tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1578 microversion: 2.1 time: 0.162199 Aug 09 19:24:11.658037 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 517/1035] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:11 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:11.865450 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-dbb9294b-ef16-4d07-b007-a16c9263ca10 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa50802ff70>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:11.896534 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-dbb9294b-ef16-4d07-b007-a16c9263ca10 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3" status: 200 len: 286 microversion: 2.1 time: 0.035336 Aug 09 19:24:11.897117 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 519/1036] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Aug 9 19:24:11 2022] GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:12.684283 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:12.684860 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:12.691248 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:12.691733 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:12.692170 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:12.692896 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:12.693352 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:12.693777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:12.830262 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:12.840392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5480ec6d-af7e-4c16-be3f-73037da14bb3 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1578 microversion: 2.1 time: 0.159959 Aug 09 19:24:12.841000 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 518/1037] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:12 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:12.909419 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-95883af9-12b2-4625-b55a-3fe0d593cdbe tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa50367ac10>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:12.942542 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-95883af9-12b2-4625-b55a-3fe0d593cdbe tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3" status: 200 len: 287 microversion: 2.1 time: 0.037342 Aug 09 19:24:12.943123 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 520/1038] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Aug 9 19:24:12 2022] GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:24:12.954290 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-57ba93b3-8cdd-40ee-a24e-22c1b0c0f3cc tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa5081d8f70>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:13.014945 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-57ba93b3-8cdd-40ee-a24e-22c1b0c0f3cc tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3" status: 202 len: 0 microversion: 2.1 time: 0.064421 Aug 09 19:24:13.015703 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 519/1039] 10.222.0.70 () {58 vars in 1254 bytes} [Tue Aug 9 19:24:12 2022] DELETE /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:24:13.023792 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-34946344-f3b6-4157-ba23-6c18f8adb7e1 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa5080948b0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:13.057610 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-34946344-f3b6-4157-ba23-6c18f8adb7e1 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3" status: 200 len: 286 microversion: 2.1 time: 0.037616 Aug 09 19:24:13.058295 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 521/1040] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Aug 9 19:24:13 2022] GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:24:13.863521 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:13.864613 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:13.872301 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=27 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:13.874293 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:13.874944 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:13.876651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:13.876651 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:13.877257 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:13.877905 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:13.883050 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:13.930247 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-97d83803-ac16-4f4a-abbd-d8dcd203bb61 req-9e3e059e-3713-4e9f-b111-5d2fc484c5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "028f2744-e17b-4d70-9ad5-6e5b665b3442", "name": "network-vif-deleted", "tag": "36ca2417-d299-4b53-9b7a-d20e1f7bf431"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:13.947371 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-97d83803-ac16-4f4a-abbd-d8dcd203bb61 req-9e3e059e-3713-4e9f-b111-5d2fc484c5e0 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:13.947827 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-97d83803-ac16-4f4a-abbd-d8dcd203bb61 req-9e3e059e-3713-4e9f-b111-5d2fc484c5e0 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:13.948996 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-97d83803-ac16-4f4a-abbd-d8dcd203bb61 req-9e3e059e-3713-4e9f-b111-5d2fc484c5e0 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:13.956929 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:13.965681 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-97d83803-ac16-4f4a-abbd-d8dcd203bb61 req-9e3e059e-3713-4e9f-b111-5d2fc484c5e0 service nova] Creating event network-vif-deleted:36ca2417-d299-4b53-9b7a-d20e1f7bf431 for instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 on hv-cinder-85265 Aug 09 19:24:13.965906 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-81bbfabc-5323-432f-b3e1-f08dca2401c6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 200 len: 1391 microversion: 2.1 time: 0.107640 Aug 09 19:24:13.966340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 520/1041] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:13 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 1391 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:13.982030 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-97d83803-ac16-4f4a-abbd-d8dcd203bb61 req-9e3e059e-3713-4e9f-b111-5d2fc484c5e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056508 Aug 09 19:24:13.982785 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 522/1042] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:24:14.070127 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5c4e6462-5073-4229-b6e1-3deedc66667b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa5084e4a60>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:14.099355 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-5c4e6462-5073-4229-b6e1-3deedc66667b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] HTTP exception thrown: Snapshot 6b8a8884-bffd-4bf0-b0eb-291daac50ce3 could not be found. Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5c4e6462-5073-4229-b6e1-3deedc66667b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Request method failure captured: Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 HTTP/1.1 Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rRWLwEnc7lBEhY4mo53riDukP-jUpBiAiwQ3QX1e2yxGYKUfNXRkmJxVboNGEAS3CK2tFliopWhRIvia6Kyp01H7LtUsNO1zIAAuTrscNBhT6bEbQNPVpJ6jkw-rvuJlh1F5Q3FrAr9pjsfdDOLt1rQXMEs4NUBES1ZdH6b5EKrI8Q Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 109e5d91f0584aa4b85dc27928ae5538 Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:24:14.101734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_109e5d91f0584aa4b85dc27928ae5538"}]}] Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 109e5d91f0584aa4b85dc27928ae5538 Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesSnapshotsTestJSON-1270536971-project Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 8b1c6021afa542d8b5548c4dab3ebcfa Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1270536971-project Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Snapshot 6b8a8884-bffd-4bf0-b0eb-291daac50ce3 could not be found. Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '6b8a8884-bffd-4bf0-b0eb-291daac50ce3'} Aug 09 19:24:14.103407 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6b8a8884-bffd-4bf0-b0eb-291daac50ce3 could not be found. (HTTP 404) (Request-ID: req-b5fcc023-6812-40ca-a097-c5cbad115687) Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:14.104479 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:24:14.107517 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6b8a8884-bffd-4bf0-b0eb-291daac50ce3 could not be found. Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 19:24:14.109077 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6b8a8884-bffd-4bf0-b0eb-291daac50ce3 could not be found. Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6b8a8884-bffd-4bf0-b0eb-291daac50ce3 could not be found. Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5c4e6462-5073-4229-b6e1-3deedc66667b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Returning 404 to user: Snapshot 6b8a8884-bffd-4bf0-b0eb-291daac50ce3 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:14.110589 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5c4e6462-5073-4229-b6e1-3deedc66667b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3" status: 404 len: 111 microversion: 2.1 time: 0.036919 Aug 09 19:24:14.111593 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 521/1043] 10.222.0.70 () {58 vars in 1251 bytes} [Tue Aug 9 19:24:14 2022] GET /compute/v2.1/os-snapshots/6b8a8884-bffd-4bf0-b0eb-291daac50ce3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:14.113171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-7b8cb947-559b-4899-a803-bf437e0890fe tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa508094af0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:14.178835 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-7b8cb947-559b-4899-a803-bf437e0890fe tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef" status: 202 len: 0 microversion: 2.1 time: 0.069740 Aug 09 19:24:14.179414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 523/1044] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:24:14 2022] DELETE /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:24:14.189052 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-0d0f443d-191d-463a-a0c1-206cc3f9b57e tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa508102e50>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:14.244289 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-0d0f443d-191d-463a-a0c1-206cc3f9b57e tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef" status: 200 len: 345 microversion: 2.1 time: 0.059468 Aug 09 19:24:14.244995 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 522/1045] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:24:14 2022] GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:24:14.987414 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:14.988146 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 028f2744-e17b-4d70-9ad5-6e5b665b3442] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:14.994464 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:14.994942 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:14.995409 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:14.996173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:14.996653 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:14.997072 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:15.010254 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] HTTP exception thrown: Instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 could not be found. Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Request method failure captured: Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 HTTP/1.1 Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rKjR7kColiTVRyWo1F4ylw4TXQgm3y77D4BXnZRqwN8ZKqYLaLJ2Z9XV45s79_d4uR0dXTMNZZhJECb7QHr3LhoQJMPJv1Jdl0iEGOH5fvkoEkZc8e8cSyKKH25LoO-BH4boNUsuIB7KVa7a2ejCGn-VcUWTrPGbsmQcKvO5NBB7g4 Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:24:15.012630 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_faf0c6e98206493ea25654f44c9ae563"}]}] Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: f12cfb692b4b4947bc67a3199aa33e73 Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 could not be found. Aug 09 19:24:15.014306 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': '028f2744-e17b-4d70-9ad5-6e5b665b3442'} Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 could not be found. Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:15.015305 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 could not be found. Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 could not be found. Aug 09 19:24:15.016852 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.018212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Returning 404 to user: Instance 028f2744-e17b-4d70-9ad5-6e5b665b3442 could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:15.018212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f39fc2ad-9c27-4240-86df-68e2fa0c1ab8 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442" status: 404 len: 111 microversion: 2.1 time: 0.031043 Aug 09 19:24:15.018212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 524/1046] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:14 2022] GET /compute/v2.1/servers/028f2744-e17b-4d70-9ad5-6e5b665b3442 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:15.259429 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c4ddf3f2-b8d4-4aa3-8240-474ca35631f5 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa503565160>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:15.290459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-c4ddf3f2-b8d4-4aa3-8240-474ca35631f5 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] HTTP exception thrown: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c4ddf3f2-b8d4-4aa3-8240-474ca35631f5 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Request method failure captured: Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef HTTP/1.1 Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rRWLwEnc7lBEhY4mo53riDukP-jUpBiAiwQ3QX1e2yxGYKUfNXRkmJxVboNGEAS3CK2tFliopWhRIvia6Kyp01H7LtUsNO1zIAAuTrscNBhT6bEbQNPVpJ6jkw-rvuJlh1F5Q3FrAr9pjsfdDOLt1rQXMEs4NUBES1ZdH6b5EKrI8Q Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 109e5d91f0584aa4b85dc27928ae5538 Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:24:15.292423 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_109e5d91f0584aa4b85dc27928ae5538"}]}] Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 109e5d91f0584aa4b85dc27928ae5538 Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesSnapshotsTestJSON-1270536971-project Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 8b1c6021afa542d8b5548c4dab3ebcfa Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1270536971-project Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '865116e8-d60e-44e5-a8aa-f19ae9b1bcef'} Aug 09 19:24:15.295223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. (HTTP 404) (Request-ID: req-745e1e75-2b64-4376-bec1-d656843b5329) Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.296231 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:24:15.297717 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 19:24:15.299193 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c4ddf3f2-b8d4-4aa3-8240-474ca35631f5 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Returning 404 to user: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c4ddf3f2-b8d4-4aa3-8240-474ca35631f5 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef" status: 404 len: 109 microversion: 2.1 time: 0.039081 Aug 09 19:24:15.300692 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 523/1047] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:24:15 2022] GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:15.312980 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-35f11b63-9d3a-42c0-b525-41866b839d1b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa50848e670>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:15.344369 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-35f11b63-9d3a-42c0-b525-41866b839d1b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] HTTP exception thrown: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-35f11b63-9d3a-42c0-b525-41866b839d1b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Request method failure captured: Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: DELETE /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef HTTP/1.1 Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rRWLwEnc7lBEhY4mo53riDukP-jUpBiAiwQ3QX1e2yxGYKUfNXRkmJxVboNGEAS3CK2tFliopWhRIvia6Kyp01H7LtUsNO1zIAAuTrscNBhT6bEbQNPVpJ6jkw-rvuJlh1F5Q3FrAr9pjsfdDOLt1rQXMEs4NUBES1ZdH6b5EKrI8Q Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: 109e5d91f0584aa4b85dc27928ae5538 Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:24:15.346331 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_109e5d91f0584aa4b85dc27928ae5538"}]}] Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: 109e5d91f0584aa4b85dc27928ae5538 Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-VolumesSnapshotsTestJSON-1270536971-project Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: 8b1c6021afa542d8b5548c4dab3ebcfa Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1270536971-project Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': '865116e8-d60e-44e5-a8aa-f19ae9b1bcef'} Aug 09 19:24:15.348056 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. (HTTP 404) (Request-ID: req-8e3180f9-5fab-4b09-a7f6-9b1e3aba63d7) Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.349272 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 19:24:15.350707 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 19:24:15.352367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-35f11b63-9d3a-42c0-b525-41866b839d1b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Returning 404 to user: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:15.353869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-35f11b63-9d3a-42c0-b525-41866b839d1b tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef" status: 404 len: 109 microversion: 2.1 time: 0.039593 Aug 09 19:24:15.354885 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 525/1048] 10.222.0.70 () {58 vars in 1248 bytes} [Tue Aug 9 19:24:15 2022] DELETE /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:15.356935 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c0d25ecc-e96c-403a-b7ac-8db72b282d53 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Calling method '.version_select at 0x7fa5082d6d30>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:15.387191 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-c0d25ecc-e96c-403a-b7ac-8db72b282d53 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] HTTP exception thrown: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c0d25ecc-e96c-403a-b7ac-8db72b282d53 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Request method failure captured: Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef HTTP/1.1 Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rRWLwEnc7lBEhY4mo53riDukP-jUpBiAiwQ3QX1e2yxGYKUfNXRkmJxVboNGEAS3CK2tFliopWhRIvia6Kyp01H7LtUsNO1zIAAuTrscNBhT6bEbQNPVpJ6jkw-rvuJlh1F5Q3FrAr9pjsfdDOLt1rQXMEs4NUBES1ZdH6b5EKrI8Q Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 109e5d91f0584aa4b85dc27928ae5538 Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:24:15.389327 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/109e5d91f0584aa4b85dc27928ae5538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_109e5d91f0584aa4b85dc27928ae5538"}]}] Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 109e5d91f0584aa4b85dc27928ae5538 Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1270536971 Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-VolumesSnapshotsTestJSON-1270536971-project Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: 8b1c6021afa542d8b5548c4dab3ebcfa Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1270536971-project Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '865116e8-d60e-44e5-a8aa-f19ae9b1bcef'} Aug 09 19:24:15.390946 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. (HTTP 404) (Request-ID: req-5fdfb717-1f77-486e-9443-cd6edfe85d61) Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.391924 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 19:24:15.393575 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 19:24:15.395005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c0d25ecc-e96c-403a-b7ac-8db72b282d53 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] Returning 404 to user: Volume 865116e8-d60e-44e5-a8aa-f19ae9b1bcef could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c0d25ecc-e96c-403a-b7ac-8db72b282d53 tempest-VolumesSnapshotsTestJSON-1270536971 tempest-VolumesSnapshotsTestJSON-1270536971-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef" status: 404 len: 109 microversion: 2.1 time: 0.038451 Aug 09 19:24:15.396472 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 524/1049] 10.222.0.70 () {58 vars in 1245 bytes} [Tue Aug 9 19:24:15 2022] GET /compute/v2.1/os-volumes/865116e8-d60e-44e5-a8aa-f19ae9b1bcef => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:15.837294 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:15.837921 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:15.840062 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:15.845994 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:15.846450 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:15.846881 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:15.847577 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:15.848026 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:15.849102 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:15.853418 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:15.875181 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.objects.instance [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lazy-loading 'flavor' on Instance uuid 64c09854-4821-496a-a89a-053de4272467 {{(pid=117823) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:24:15.950186 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f9dad274-3fc0-4d8a-8b2e-4c48583cbc4e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "POST /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467/action" status: 202 len: 0 microversion: 2.1 time: 0.117194 Aug 09 19:24:15.950547 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 526/1050] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:24:15 2022] POST /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:24:15.959549 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:15.960244 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:15.966712 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:15.967304 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:15.968069 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:15.969005 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:15.969830 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:15.970451 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:16.113209 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:16.122144 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5194dc29-6548-4635-b2fe-ec3afab8d306 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.167135 Aug 09 19:24:16.123018 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 525/1051] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:15 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:24:17.145755 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:17.146453 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:17.153478 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:17.153964 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:17.154396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:17.155089 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:17.155536 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:17.155953 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:17.301480 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:17.309866 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-cbf6ad69-c628-41f6-8f5a-56a4b9fedb70 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.168442 Aug 09 19:24:17.310435 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 527/1052] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:17 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:24:18.163394 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:18.163918 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:18.167614 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-b91185d1-9c67-4886-bc42-13c0bd4d8919 req-6c139107-fd63-447e-a11f-dd680d310926 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51acc754-aaff-495f-9744-829f6b8d04b1", "tag": "43a7588e-3e32-4ee3-867c-c35301d5c546"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:18.180218 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-b91185d1-9c67-4886-bc42-13c0bd4d8919 req-6c139107-fd63-447e-a11f-dd680d310926 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:18.180468 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:18.180733 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-b91185d1-9c67-4886-bc42-13c0bd4d8919 req-6c139107-fd63-447e-a11f-dd680d310926 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:18.181026 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:18.181223 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-b91185d1-9c67-4886-bc42-13c0bd4d8919 req-6c139107-fd63-447e-a11f-dd680d310926 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:18.181621 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:18.182401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:18.182986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:18.184121 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:18.198146 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-b91185d1-9c67-4886-bc42-13c0bd4d8919 req-6c139107-fd63-447e-a11f-dd680d310926 service nova] Creating event network-changed:43a7588e-3e32-4ee3-867c-c35301d5c546 for instance 51acc754-aaff-495f-9744-829f6b8d04b1 on hv-cinder-85265 Aug 09 19:24:18.204625 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-b91185d1-9c67-4886-bc42-13c0bd4d8919 req-6c139107-fd63-447e-a11f-dd680d310926 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041311 Aug 09 19:24:18.205898 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 528/1053] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:24:18.214662 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:24:18.318049 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-4974484c-2cfe-46e4-80b9-a64c0682ed5b tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "DELETE /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 204 len: 0 microversion: 2.1 time: 0.158731 Aug 09 19:24:18.319112 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 526/1054] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:24:18 2022] DELETE /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:24:18.330618 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:18.331127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:18.343335 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:18.344737 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:18.345488 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:18.346273 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:18.346876 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:18.347755 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:18.351166 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:18.351714 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:18.356777 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:18.358223 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:18.358999 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:18.360541 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:18.361183 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:18.361810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:18.557756 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:18.568181 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-d3466d87-07f5-4c4d-b175-fe87660e4b61 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.232293 Aug 09 19:24:18.573927 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 527/1055] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:18 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:18.588214 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:18.598756 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-79036191-3152-4e6f-b5e3-39154fe0d198 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1575 microversion: 2.1 time: 0.275082 Aug 09 19:24:18.599623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 529/1056] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:18 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1575 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:24:19.590821 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:19.591514 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:19.598291 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:19.598850 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:19.599578 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:19.600665 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:19.601215 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:19.601683 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:19.623311 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:19.624185 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:19.631705 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:19.632871 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:19.633525 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:19.634427 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:19.635104 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:19.635914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:19.796566 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:19.807484 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-bafac9bd-c3b7-41c2-b65d-520a37b97e4f tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1575 microversion: 2.1 time: 0.189139 Aug 09 19:24:19.809365 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 530/1057] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:19 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 19:24:19.866351 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:19.874564 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-28c2cd47-1fb3-4f81-8549-35ba1ca3ff10 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.287780 Aug 09 19:24:19.875300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 528/1058] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:19 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:20.431642 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-4e642bf1-9ad6-4bc6-9ff6-e84d7978d3da req-2c6682ea-e5c5-40c2-8e01-00f6da43074b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51acc754-aaff-495f-9744-829f6b8d04b1", "name": "network-vif-deleted", "tag": "43a7588e-3e32-4ee3-867c-c35301d5c546"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:20.442560 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4e642bf1-9ad6-4bc6-9ff6-e84d7978d3da req-2c6682ea-e5c5-40c2-8e01-00f6da43074b service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:20.443041 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4e642bf1-9ad6-4bc6-9ff6-e84d7978d3da req-2c6682ea-e5c5-40c2-8e01-00f6da43074b service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:20.443466 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-4e642bf1-9ad6-4bc6-9ff6-e84d7978d3da req-2c6682ea-e5c5-40c2-8e01-00f6da43074b service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:20.458484 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-4e642bf1-9ad6-4bc6-9ff6-e84d7978d3da req-2c6682ea-e5c5-40c2-8e01-00f6da43074b service nova] Creating event network-vif-deleted:43a7588e-3e32-4ee3-867c-c35301d5c546 for instance 51acc754-aaff-495f-9744-829f6b8d04b1 on hv-cinder-85265 Aug 09 19:24:20.463694 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-4e642bf1-9ad6-4bc6-9ff6-e84d7978d3da req-2c6682ea-e5c5-40c2-8e01-00f6da43074b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036466 Aug 09 19:24:20.465310 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 531/1059] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:20.831246 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:20.831743 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:20.839392 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:20.839995 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:20.840570 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:20.841288 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:20.841833 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:20.842265 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:20.879237 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:20.879731 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:20.880171 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:20.880650 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.objects.instance [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lazy-loading 'fault' on Instance uuid 51acc754-aaff-495f-9744-829f6b8d04b1 {{(pid=117822) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 19:24:20.898407 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:20.899108 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:20.908826 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:20.909317 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:20.909754 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:20.910460 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:20.910911 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:20.911334 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:20.932466 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f12cfb692b4b4947bc67a3199aa33e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faf0c6e98206493ea25654f44c9ae563', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:20.941848 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b8d8fc32-9361-4704-a2ac-ed0fe746994e tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 200 len: 1229 microversion: 2.1 time: 0.114564 Aug 09 19:24:20.942725 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 529/1060] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:20 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:21.067307 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:21.079252 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-86d2b121-68c3-493d-b700-444186da2a40 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.185403 Aug 09 19:24:21.079883 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 532/1061] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:20 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:21.966835 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:21.967459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 51acc754-aaff-495f-9744-829f6b8d04b1] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:21.974070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:21.974561 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:21.975133 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:21.975854 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:21.976308 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:21.976759 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:21.993452 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] HTTP exception thrown: Instance 51acc754-aaff-495f-9744-829f6b8d04b1 could not be found. Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Request method failure captured: Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 HTTP/1.1 Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rKjR7kColiTVRyWo1F4ylw4TXQgm3y77D4BXnZRqwN8ZKqYLaLJ2Z9XV45s79_d4uR0dXTMNZZhJECb7QHr3LhoQJMPJv1Jdl0iEGOH5fvkoEkZc8e8cSyKKH25LoO-BH4boNUsuIB7KVa7a2ejCGn-VcUWTrPGbsmQcKvO5NBB7g4 Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:24:21.995219 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_faf0c6e98206493ea25654f44c9ae563"}]}] Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: f12cfb692b4b4947bc67a3199aa33e73 Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 51acc754-aaff-495f-9744-829f6b8d04b1 could not be found. Aug 09 19:24:21.997467 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '51acc754-aaff-495f-9744-829f6b8d04b1'} Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51acc754-aaff-495f-9744-829f6b8d04b1 could not be found. Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:21.998232 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51acc754-aaff-495f-9744-829f6b8d04b1 could not be found. Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51acc754-aaff-495f-9744-829f6b8d04b1 could not be found. Aug 09 19:24:21.999895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.001381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Returning 404 to user: Instance 51acc754-aaff-495f-9744-829f6b8d04b1 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:22.001381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5777035c-8a8a-40b1-8585-056b1f9b22d0 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1" status: 404 len: 111 microversion: 2.1 time: 0.035964 Aug 09 19:24:22.001381 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 530/1062] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:21 2022] GET /compute/v2.1/servers/51acc754-aaff-495f-9744-829f6b8d04b1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:22.107158 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:22.109768 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:22.126346 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:22.128023 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:22.129330 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:22.130794 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:22.131623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:22.132161 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:22.351959 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:22.360831 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-c72aa33f-2fc9-4125-8eed-bf9f7ca57f8e tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.261508 Aug 09 19:24:22.376117 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 533/1063] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:22 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:22.588090 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:22.588708 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:22.597218 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:22.597967 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:22.598481 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:22.599272 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:22.599790 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:22.600388 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:22.614819 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] HTTP exception thrown: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Request method failure captured: Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: DELETE /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e HTTP/1.1 Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rKjR7kColiTVRyWo1F4ylw4TXQgm3y77D4BXnZRqwN8ZKqYLaLJ2Z9XV45s79_d4uR0dXTMNZZhJECb7QHr3LhoQJMPJv1Jdl0iEGOH5fvkoEkZc8e8cSyKKH25LoO-BH4boNUsuIB7KVa7a2ejCGn-VcUWTrPGbsmQcKvO5NBB7g4 Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:24:22.616298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_faf0c6e98206493ea25654f44c9ae563"}]}] Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: f12cfb692b4b4947bc67a3199aa33e73 Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.617826 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '1c627b1d-06ef-4702-9080-ee169c06437e'} Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:22.618643 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.619893 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.621393 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Returning 404 to user: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:22.621393 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-89e32dc0-e4e4-4d46-9fa8-4e09c73c3456 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 404 len: 111 microversion: 2.1 time: 0.033646 Aug 09 19:24:22.621393 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 531/1064] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:24:22 2022] DELETE /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:22.627445 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:22.627992 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] [instance: 1c627b1d-06ef-4702-9080-ee169c06437e] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:22.633937 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:22.634413 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:22.634848 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:22.635544 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:22.635974 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:22.637384 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:22.650527 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.wsgi [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] HTTP exception thrown: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Request method failure captured: Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: request: GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e HTTP/1.1 Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept: application/json Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Accept-Encoding: identity Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Connection: close Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Length: 0 Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Content-Type: application/json Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Host: 10.222.0.70 Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Openstack-System-Scope: None Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: User-Agent: python-urllib3/1.26.11 Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Auth-Token: gAAAAABi8rKjR7kColiTVRyWo1F4ylw4TXQgm3y77D4BXnZRqwN8ZKqYLaLJ2Z9XV45s79_d4uR0dXTMNZZhJECb7QHr3LhoQJMPJv1Jdl0iEGOH5fvkoEkZc8e8cSyKKH25LoO-BH4boNUsuIB7KVa7a2ejCGn-VcUWTrPGbsmQcKvO5NBB7g4 Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Id: None Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Domain-Name: None Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Identity-Status: Confirmed Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Is-Admin-Project: True Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Id: default Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Domain-Name: Default Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Project-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Role: member,reader Aug 09 19:24:22.652283 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Roles: member,reader Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/faf0c6e98206493ea25654f44c9ae563"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_faf0c6e98206493ea25654f44c9ae563"}]}] Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Id: faf0c6e98206493ea25654f44c9ae563 Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-Tenant-Name: tempest-TestVolumeBootPattern-77167014 Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Id: default Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Domain-Name: Default Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Id: f12cfb692b4b4947bc67a3199aa33e73 Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: X-User-Name: tempest-TestVolumeBootPattern-77167014-project Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: method: > Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: exception: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.654040 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: action_args: {'id': '1c627b1d-06ef-4702-9080-ee169c06437e'} Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:24:22.654837 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. Aug 09 19:24:22.656091 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: ERROR nova.api.openstack.wsgi Aug 09 19:24:22.657246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Returning 404 to user: Instance 1c627b1d-06ef-4702-9080-ee169c06437e could not be found. {{(pid=117823) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:24:22.657246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-1d0d40ad-6c0b-4d56-a7e2-16e38e04a6e6 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e" status: 404 len: 111 microversion: 2.1 time: 0.030657 Aug 09 19:24:22.657246 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 534/1065] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:22 2022] GET /compute/v2.1/servers/1c627b1d-06ef-4702-9080-ee169c06437e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:24:23.389971 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:23.390390 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:23.396619 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:23.397038 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:23.397519 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:23.398331 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:23.398839 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:23.399184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:23.536204 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:23.544852 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-f55dc15a-f1a9-4021-929f-fc02982402e5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.165435 Aug 09 19:24:23.545427 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 532/1066] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:23 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:24.234935 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-6ef00421-ba39-4a55-a23e-1d0d49c579b2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] Calling method '.version_select at 0x7fa5037c13a0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:24.259290 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-6ef00421-ba39-4a55-a23e-1d0d49c579b2 tempest-TestVolumeBootPattern-77167014 tempest-TestVolumeBootPattern-77167014-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-205325892" status: 202 len: 0 microversion: 2.1 time: 0.029616 Aug 09 19:24:24.259963 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 535/1067] 10.222.0.70 () {58 vars in 1260 bytes} [Tue Aug 9 19:24:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-205325892 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:24:24.568119 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:24.569964 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:24.578986 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:24.579469 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:24.580035 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:24.580847 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:24.581395 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:24.581991 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:24.729996 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:24.741521 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-b92911f9-c623-49af-b118-4005056917bf tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.177887 Aug 09 19:24:24.742368 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 533/1068] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:24 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:25.763688 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:25.764367 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:25.772314 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:25.773109 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:25.773526 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:25.774245 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:25.774698 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:25.775204 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:25.971282 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:25.989096 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-4e3c6f87-7f7d-4d8b-8c9d-dde5226769b0 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.229672 Aug 09 19:24:25.989600 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 536/1069] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:25 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:27.011191 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:27.012431 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:27.020806 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:27.022173 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:27.022935 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:27.024075 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:27.025622 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:27.026562 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:27.223237 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:27.232401 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-8094731e-f14a-4f1b-be82-e29d0305222a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.225353 Aug 09 19:24:27.233250 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 534/1070] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:27 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:28.255127 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:28.255850 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:28.263378 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:28.263857 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:28.264285 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:28.265017 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:28.265458 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:28.265874 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:28.422481 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:28.431725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-3dff7f77-a84e-4b19-8731-7818ff4cbda6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.180406 Aug 09 19:24:28.432740 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 537/1071] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:28 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:29.454335 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:29.456058 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:29.462952 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:29.463739 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:29.464172 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:29.465581 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:29.466068 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:29.466486 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:29.718066 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:29.727921 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-eed79661-b7df-47fa-918e-5e0795302b68 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1568 microversion: 2.1 time: 0.277720 Aug 09 19:24:29.728617 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 535/1072] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:29 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1568 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:29.755113 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:29.756298 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:29.764143 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:29.764923 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:29.765569 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:29.766454 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:29.767320 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:29.767968 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:29.811173 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117823) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 19:24:29.899407 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ae94fc33-c2fd-41d9-9112-271be1edcfee tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "POST /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467/action" status: 202 len: 0 microversion: 2.1 time: 0.148700 Aug 09 19:24:29.900750 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 538/1073] 10.222.0.70 () {60 vars in 1278 bytes} [Tue Aug 9 19:24:29 2022] POST /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 19:24:29.909661 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:29.916969 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:29.927109 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:29.927864 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:29.928588 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:29.929543 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:29.930220 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:29.930883 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:30.501793 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:30.511166 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-318c9221-5c83-4015-b5fe-3db6e98f10ef tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1516 microversion: 2.1 time: 0.605452 Aug 09 19:24:30.512710 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 536/1074] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:29 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1516 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:31.537631 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:31.539590 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:31.549178 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:31.550001 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:31.550444 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:31.551212 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:31.551731 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:31.552344 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:31.862702 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-86640ec6-479f-468f-97aa-0e5bbd65c50e req-47abb481-c216-49d0-98e6-5e2906e2273d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c09854-4821-496a-a89a-053de4272467", "name": "network-vif-unplugged", "status": "completed", "tag": "d04d022a-42d1-4154-87e8-1d6b847ea063"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:31.875702 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-86640ec6-479f-468f-97aa-0e5bbd65c50e req-47abb481-c216-49d0-98e6-5e2906e2273d service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:31.876677 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-86640ec6-479f-468f-97aa-0e5bbd65c50e req-47abb481-c216-49d0-98e6-5e2906e2273d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:31.877309 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-86640ec6-479f-468f-97aa-0e5bbd65c50e req-47abb481-c216-49d0-98e6-5e2906e2273d service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:31.894379 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.compute.server_external_events [req-86640ec6-479f-468f-97aa-0e5bbd65c50e req-47abb481-c216-49d0-98e6-5e2906e2273d service nova] Unable to find a host for instance 64c09854-4821-496a-a89a-053de4272467. Dropping event network-vif-unplugged {{(pid=117822) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 19:24:31.895557 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-86640ec6-479f-468f-97aa-0e5bbd65c50e req-47abb481-c216-49d0-98e6-5e2906e2273d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036764 Aug 09 19:24:31.896866 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 537/1075] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 19:24:32.036233 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:32.046396 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ec3c6c31-82ba-4b82-b817-38f1288de3a5 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1518 microversion: 2.1 time: 0.516552 Aug 09 19:24:32.046976 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 539/1076] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:31 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1518 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:33.069064 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:33.069618 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:33.076298 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:33.077209 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:33.077821 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:33.078810 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:33.079715 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:33.080137 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:33.342259 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:33.351684 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-9ebbe487-68ec-4a76-817a-bb9c5effce7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.286828 Aug 09 19:24:33.356497 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 538/1077] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:33 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:34.374587 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:34.375189 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:34.381597 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:34.382075 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:34.382522 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:34.383214 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:34.383663 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:34.384085 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:34.521450 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:34.530574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-2fb5e708-ec30-4664-8052-c77e0a350286 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.160394 Aug 09 19:24:34.531179 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 540/1078] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:34 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:35.553101 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:35.553746 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:35.560784 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:35.561270 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:35.561708 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:35.562402 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:35.562857 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:35.563284 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:35.692056 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:35.700725 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-696ea8c7-9d79-48c2-9c5b-e4d44e78d6af tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.151473 Aug 09 19:24:35.701295 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 539/1079] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:35 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:36.722483 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:36.723083 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:36.729623 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:36.730375 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:36.731150 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:36.731914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:36.732382 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:36.732844 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:36.900317 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:36.908725 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-ef1147aa-0bb0-45de-9249-a37c03c61841 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.190341 Aug 09 19:24:36.909300 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 541/1080] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:36 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:37.931148 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:37.931748 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:37.938226 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:37.938709 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:37.939141 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:37.939828 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:37.940281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:37.940740 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:38.077459 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:38.079771 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:38.086980 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-5dcd8a1b-4c0d-4f7b-9364-16095ffb7181 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.159696 Aug 09 19:24:38.087555 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 540/1081] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:37 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:39.109160 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:39.109770 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:39.116325 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:39.116829 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:39.117258 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:39.117932 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:39.118377 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:39.118791 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:39.262752 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:39.265130 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:39.272171 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-f367dc92-3d1c-4f02-b4d4-a1cd062b6a97 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.167393 Aug 09 19:24:39.272799 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 542/1082] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:39 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:40.296340 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:40.297356 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:40.304981 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:40.305461 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:40.305895 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:40.306585 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:40.307036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:40.307458 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:40.442035 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:40.450006 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-047dfdcd-b36e-4c40-b728-e8be5a1d8c42 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.159718 Aug 09 19:24:40.450581 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 541/1083] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:40 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:41.470612 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:41.471224 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:41.478749 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:41.479234 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:41.480177 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:41.480906 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:41.481358 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:41.481782 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:41.613780 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:41.621397 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8d9aeadb-9583-4c0c-b48c-b45607b0de62 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.154686 Aug 09 19:24:41.621964 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 543/1084] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:41 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:42.642665 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:42.643227 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:42.649824 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:42.650310 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:42.650742 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:42.651432 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:42.652013 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:42.652463 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:42.789622 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:42.798167 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-39fc8cd3-ada8-431d-a97a-d733d6acfc7a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.159479 Aug 09 19:24:42.798727 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 542/1085] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:42 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:43.819401 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:43.820109 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:43.827422 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:43.827914 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:43.828347 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:43.829069 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:43.829517 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:43.829937 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:43.881966 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-41bacc1c-60c5-4ba5-99af-c2a6457573c2 req-37815cf6-ca6b-4c31-a91e-ef5599e81a8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c09854-4821-496a-a89a-053de4272467", "name": "network-vif-plugged", "status": "completed", "tag": "d04d022a-42d1-4154-87e8-1d6b847ea063"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:24:43.896683 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-41bacc1c-60c5-4ba5-99af-c2a6457573c2 req-37815cf6-ca6b-4c31-a91e-ef5599e81a8b service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:43.897502 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-41bacc1c-60c5-4ba5-99af-c2a6457573c2 req-37815cf6-ca6b-4c31-a91e-ef5599e81a8b service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:43.898284 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-41bacc1c-60c5-4ba5-99af-c2a6457573c2 req-37815cf6-ca6b-4c31-a91e-ef5599e81a8b service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:43.910704 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-41bacc1c-60c5-4ba5-99af-c2a6457573c2 req-37815cf6-ca6b-4c31-a91e-ef5599e81a8b service nova] Creating event network-vif-plugged:d04d022a-42d1-4154-87e8-1d6b847ea063 for instance 64c09854-4821-496a-a89a-053de4272467 on hv-cinder-85265 Aug 09 19:24:43.916283 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-41bacc1c-60c5-4ba5-99af-c2a6457573c2 req-37815cf6-ca6b-4c31-a91e-ef5599e81a8b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039652 Aug 09 19:24:43.917038 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 543/1086] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:24:43.991465 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:43.999966 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-49a6e32a-42fd-4887-bb3c-60f982a226fc tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.184469 Aug 09 19:24:44.000549 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 544/1087] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:43 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:45.023746 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:45.024455 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:45.026424 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:45.033233 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:45.033719 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:45.034159 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:45.034846 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:45.035297 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:45.035718 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:45.168769 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:45.178871 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-353443c7-b54c-413e-89ad-a33ede730fe6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1574 microversion: 2.1 time: 0.159535 Aug 09 19:24:45.179443 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 544/1088] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:45 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:24:46.203241 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:24:46.203810 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:24:46.206208 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:24:46.211132 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:46.211611 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:46.212041 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:46.212750 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:24:46.213201 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:24:46.213622 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:24:46.347332 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:24:46.354805 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-15d245c5-eb44-466e-ba8c-d205b6bb9be6 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1561 microversion: 2.1 time: 0.156187 Aug 09 19:24:46.355995 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 545/1089] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:24:46 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:25:32.931977 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:25:32.932617 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Tue Aug 9 19:25:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:25:43.358688 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:25:43.359481 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Tue Aug 9 19:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:26:05.895036 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33af4550-79d5-4ca1-9c1d-013f67972203] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 19:26:05.895854 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_api:SELECT=1 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:26:05.896903 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG dbcounter [-] [117822] Writing DB stats nova_cell1:SELECT=21 {{(pid=117822) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:26:05.897493 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_api:SELECT=1 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:26:05.899092 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG dbcounter [-] [117823] Writing DB stats nova_cell1:SELECT=19 {{(pid=117823) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 19:26:05.901189 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:26:05.901751 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:26:05.913532 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:05.914032 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:05.914473 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:05.915184 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:05.915816 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:05.916257 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:05.945587 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Going to try to terminate instance {{(pid=117822) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 19:26:06.032990 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-921492b7-c3ea-4da4-ab2e-1c58706cb48f tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "DELETE /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 204 len: 0 microversion: 2.1 time: 0.137945 Aug 09 19:26:06.037068 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 545/1090] 10.222.0.70 () {58 vars in 1239 bytes} [Tue Aug 9 19:26:05 2022] DELETE /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 19:26:06.042956 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:26:06.043658 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:26:06.050784 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:06.051302 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:06.051725 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:06.052461 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:06.052917 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:06.053343 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:06.136821 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [req-74489f04-0c3c-4634-b6e4-c59920e967e5 req-ceabe2ff-58b8-40ee-ab9d-2b67f6cddc56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c09854-4821-496a-a89a-053de4272467", "tag": "d04d022a-42d1-4154-87e8-1d6b847ea063"}]} {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:26:06.146285 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-74489f04-0c3c-4634-b6e4-c59920e967e5 req-ceabe2ff-58b8-40ee-ab9d-2b67f6cddc56 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:06.146764 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-74489f04-0c3c-4634-b6e4-c59920e967e5 req-ceabe2ff-58b8-40ee-ab9d-2b67f6cddc56 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:06.147188 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [req-74489f04-0c3c-4634-b6e4-c59920e967e5 req-ceabe2ff-58b8-40ee-ab9d-2b67f6cddc56 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:06.160969 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.compute.server_external_events [req-74489f04-0c3c-4634-b6e4-c59920e967e5 req-ceabe2ff-58b8-40ee-ab9d-2b67f6cddc56 service nova] Creating event network-changed:d04d022a-42d1-4154-87e8-1d6b847ea063 for instance 64c09854-4821-496a-a89a-053de4272467 on hv-cinder-85265 Aug 09 19:26:06.166310 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [req-74489f04-0c3c-4634-b6e4-c59920e967e5 req-ceabe2ff-58b8-40ee-ab9d-2b67f6cddc56 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270709 Aug 09 19:26:06.167006 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 546/1091] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 19:26:06.208998 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.policy [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117822) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:26:06.216580 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-ecd213fe-94be-4e7e-acfd-69d27114cdcd tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.178240 Aug 09 19:26:06.217155 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 546/1092] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:26:06 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:26:07.241322 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:26:07.242039 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:26:07.248098 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:07.248701 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:07.249743 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:07.250426 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:07.250869 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:07.251284 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:07.429192 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:26:07.437609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-8ffa97d9-3695-4f3d-a4ee-1e068221b215 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1567 microversion: 2.1 time: 0.201804 Aug 09 19:26:07.438165 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 547/1093] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:26:07 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:26:08.337475 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO oslo.messaging._drivers.impl_rabbit [-] [33af4550-79d5-4ca1-9c1d-013f67972203] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 52020. Aug 09 19:26:08.402910 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [req-1bc2972d-51e1-489b-96c2-0ab16e351c28 req-60bd8e1c-e015-41e9-be8d-5175d7a7a8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c09854-4821-496a-a89a-053de4272467", "name": "network-vif-deleted", "tag": "d04d022a-42d1-4154-87e8-1d6b847ea063"}]} {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 19:26:08.416928 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1bc2972d-51e1-489b-96c2-0ab16e351c28 req-60bd8e1c-e015-41e9-be8d-5175d7a7a8a4 service nova] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:08.417680 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1bc2972d-51e1-489b-96c2-0ab16e351c28 req-60bd8e1c-e015-41e9-be8d-5175d7a7a8a4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:08.418174 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [req-1bc2972d-51e1-489b-96c2-0ab16e351c28 req-60bd8e1c-e015-41e9-be8d-5175d7a7a8a4 service nova] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:08.430610 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.compute.server_external_events [req-1bc2972d-51e1-489b-96c2-0ab16e351c28 req-60bd8e1c-e015-41e9-be8d-5175d7a7a8a4 service nova] Creating event network-vif-deleted:d04d022a-42d1-4154-87e8-1d6b847ea063 for instance 64c09854-4821-496a-a89a-053de4272467 on hv-cinder-85265 Aug 09 19:26:08.435706 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [req-1bc2972d-51e1-489b-96c2-0ab16e351c28 req-60bd8e1c-e015-41e9-be8d-5175d7a7a8a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114304 Aug 09 19:26:08.436300 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 547/1094] 10.222.0.70 () {64 vars in 1317 bytes} [Tue Aug 9 19:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 19:26:08.458525 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:26:08.459142 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.compute.api [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117823) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:26:08.465554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:08.466032 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:08.466456 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:08.467164 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:08.467609 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:08.468743 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG oslo_concurrency.lockutils [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117823) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:08.530100 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.policy [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b66be721908a4eb1a136d416a4d8b2f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57933942d654420985e7bc588dc98c1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117823) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 19:26:08.538139 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-756eaed0-ee2e-4831-98d0-413498a11850 tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 200 len: 1218 microversion: 2.1 time: 0.083464 Aug 09 19:26:08.538701 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 548/1095] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:26:08 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 19:26:09.660389 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '>' {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:26:09.661131 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.compute.api [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] [instance: 64c09854-4821-496a-a89a-053de4272467] Fetching instance by UUID {{(pid=117822) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 19:26:09.667281 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:09.668029 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:09.668494 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:09.669191 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Acquiring lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 19:26:09.669645 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 19:26:09.670070 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG oslo_concurrency.lockutils [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Lock "00066696-20f3-4c56-9a74-e60e6ce0ffd8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117822) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 19:26:09.683751 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.wsgi [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] HTTP exception thrown: Instance 64c09854-4821-496a-a89a-053de4272467 could not be found. Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Request method failure captured: Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: request: GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 HTTP/1.1 Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept: application/json Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Accept-Encoding: identity Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Connection: close Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Length: 0 Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Content-Type: application/json Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Host: 10.222.0.70 Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Openstack-System-Scope: None Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: User-Agent: python-urllib3/1.26.11 Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Auth-Token: gAAAAABi8rOdCihscrqP3b_1ewjhoSCVHb0-kiYsXeSs6UOMGy-9FjPnMHifaikvhtvJcYkfowKZN9449EVjKkiSMtisKGdPaE4f1Dk2965YHZRzbfUt-zONQKSBMSNYk5Lb7UZIcOYoMD4XytakNfT2-fDTOKD7SpNuiGvhKNuN8Q1cPxcwl-w Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Id: None Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Domain-Name: None Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Identity-Status: Confirmed Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Is-Admin-Project: True Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Id: default Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Domain-Name: Default Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Id: 57933942d654420985e7bc588dc98c1f Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Project-Name: tempest-TestShelveInstance-604681313 Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Role: member,reader Aug 09 19:26:09.685410 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Roles: member,reader Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/57933942d654420985e7bc588dc98c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/57933942d654420985e7bc588dc98c1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/57933942d654420985e7bc588dc98c1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.70:8080", "publicURL": "http://10.222.0.70:8080/v1/AUTH_57933942d654420985e7bc588dc98c1f"}]}] Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant: tempest-TestShelveInstance-604681313 Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Id: 57933942d654420985e7bc588dc98c1f Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-Tenant-Name: tempest-TestShelveInstance-604681313 Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User: tempest-TestShelveInstance-604681313-project Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Id: default Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Domain-Name: Default Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Id: b66be721908a4eb1a136d416a4d8b2f9 Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: X-User-Name: tempest-TestShelveInstance-604681313-project Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: method: > Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: exception: Instance 64c09854-4821-496a-a89a-053de4272467 could not be found. Aug 09 19:26:09.688260 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: action_args: {'id': '64c09854-4821-496a-a89a-053de4272467'} Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: {{(pid=117822) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c09854-4821-496a-a89a-053de4272467 could not be found. Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 19:26:09.689425 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c09854-4821-496a-a89a-053de4272467 could not be found. Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c09854-4821-496a-a89a-053de4272467 could not be found. Aug 09 19:26:09.691217 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: ERROR nova.api.openstack.wsgi Aug 09 19:26:09.692734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: DEBUG nova.api.openstack.wsgi [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Returning 404 to user: Instance 64c09854-4821-496a-a89a-053de4272467 could not be found. {{(pid=117822) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 19:26:09.692734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO nova.api.openstack.requestlog [None req-c7b9de10-e5e3-4444-814c-292e4ca5d8ba tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467" status: 404 len: 111 microversion: 2.1 time: 0.131364 Aug 09 19:26:09.692734 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: [pid: 117822|app: 0|req: 548/1096] 10.222.0.70 () {58 vars in 1236 bytes} [Tue Aug 9 19:26:09 2022] GET /compute/v2.1/servers/64c09854-4821-496a-a89a-053de4272467 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 19:26:09.861554 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: DEBUG nova.api.openstack.wsgi [None req-cc6d0d65-6571-44a8-8427-5d107a19f37a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] Calling method '.version_select at 0x7fa5080948b0>' {{(pid=117823) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 19:26:09.883529 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO nova.api.openstack.requestlog [None req-cc6d0d65-6571-44a8-8427-5d107a19f37a tempest-TestShelveInstance-604681313 tempest-TestShelveInstance-604681313-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1809775392" status: 202 len: 0 microversion: 2.1 time: 0.026917 Aug 09 19:26:09.884159 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: [pid: 117823|app: 0|req: 549/1097] 10.222.0.70 () {58 vars in 1254 bytes} [Tue Aug 9 19:26:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1809775392 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 19:27:23.736507 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:27:23.737189 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Tue Aug 9 19:27:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:28:52.941571 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:28:52.942208 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Tue Aug 9 19:28:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:29:00.750574 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:29:00.751151 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Tue Aug 9 19:29:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:29:03.368080 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:29:03.368544 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Tue Aug 9 19:29:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:29:17.918613 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:29:17.919245 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Tue Aug 9 19:29:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:29:20.569683 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:29:20.570234 dv-cinder-852654-1-iscsi devstack@n-api.service[117822]: Tue Aug 9 19:29:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 19:30:43.745167 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 19:30:43.745794 dv-cinder-852654-1-iscsi devstack@n-api.service[117823]: Tue Aug 9 19:30:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!